2024-04-25T09:19:54.518 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T09:19:54.518 DEBUG:teuthology.run:Teuthology command: teuthology --name matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi --archive /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981 --verbose --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} --owner scheduled_matan@teuthology -- /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/orig.config.yaml 2024-04-25T09:19:54.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:19:54.651 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981 branch: wip-matanb-crimson-testing-april-22 description: crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} email: null first_in_suite: false job_id: '7672981' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-april-22 ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: bluestore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 472cc2b524a88306ef4535053d26658c5fd6e9db owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1211 sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 472cc2b524a88306ef4535053d26658c5fd6e9db targets: smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGhkootENZ71WBWAF+F1z6s4sAto/rU2ncEOqHA+2Ueljbpu7wTYVHkpPZbZNa7OBGMA9fkq6y1jWDVq2Uhqk8= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLwxBZG9FMZXPK36TWfeJjEm+7P24bDJnjPfMf8NQwUBmcyzFz800eK5ZVNQxLlQwesLC07WQQRs015McaGbn/Q= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:07:11 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T09:19:54.651 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa; will attempt to use it 2024-04-25T09:19:54.652 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa/tasks 2024-04-25T09:19:54.652 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T09:19:54.654 INFO:teuthology.task.internal:Checking packages... 2024-04-25T09:19:54.677 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'a126334d8733673d119ffdf40d6ae4b541a0a1cd' 2024-04-25T09:19:54.677 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T09:19:54.677 INFO:teuthology.packaging:ref: None 2024-04-25T09:19:54.677 INFO:teuthology.packaging:tag: None 2024-04-25T09:19:54.677 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-april-22 2024-04-25T09:19:54.677 INFO:teuthology.packaging:sha1: a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:19:54.677 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-april-22 2024-04-25T09:19:54.818 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3194.ga126334d 2024-04-25T09:19:54.820 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T09:19:54.828 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T09:19:54.828 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T09:19:54.848 INFO:teuthology.task.internal:Saving configuration 2024-04-25T09:19:54.866 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T09:19:54.874 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:19:54.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 09:14:40.408674', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGhkootENZ71WBWAF+F1z6s4sAto/rU2ncEOqHA+2Ueljbpu7wTYVHkpPZbZNa7OBGMA9fkq6y1jWDVq2Uhqk8='} 2024-04-25T09:19:54.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 09:14:40.407149', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLwxBZG9FMZXPK36TWfeJjEm+7P24bDJnjPfMf8NQwUBmcyzFz800eK5ZVNQxLlQwesLC07WQQRs015McaGbn/Q='} 2024-04-25T09:19:54.924 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T09:19:54.930 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-04-25T09:19:54.930 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-25T09:19:54.930 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T09:19:55.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a71eebe50>, signals=[15]) 2024-04-25T09:19:55.008 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T09:19:55.016 INFO:teuthology.task.internal:Opening connections... 2024-04-25T09:19:55.016 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T09:19:55.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:19:55.095 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T09:19:55.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:19:55.170 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T09:19:55.177 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-04-25T09:19:55.196 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-04-25T09:19:55.196 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-04-25T09:19:55.253 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T09:19:55.254 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-04-25T09:19:55.254 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T09:19:55.254 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T09:19:55.254 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T09:19:55.254 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-04-25T09:19:55.274 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-25T09:19:55.293 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-25T09:19:55.293 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-25T09:19:55.351 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-25T09:19:55.351 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-25T09:19:55.351 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-25T09:19:55.351 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-25T09:19:55.351 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-25T09:19:55.351 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-25T09:19:55.351 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T09:19:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-25T09:19:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-25T09:19:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T09:19:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-25T09:19:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T09:19:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T09:19:55.352 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T09:19:55.352 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-25T09:19:55.381 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T09:19:55.392 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T09:19:55.398 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T09:19:55.398 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:19:55.401 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:19:55.416 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T09:19:55.422 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T09:19:55.422 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:19:55.457 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:19:55.557 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T09:19:55.612 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T09:19:55.626 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T09:19:55.627 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T09:19:55.627 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:19:55.628 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:19:55.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:19:55.644 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-04-25T09:19:55.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:19:55.645 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-25T09:19:55.702 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-437.el9.x86_64 2024-04-25T09:19:55.702 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-437.el9.x86_64 2024-04-25T09:19:55.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-04-25T09:19:55.704 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-437.el9.x86_64 2024-04-25T09:19:55.704 INFO:teuthology.task.kernel:Running kernel on smithi165: 5.14.0-437.el9.x86_64 2024-04-25T09:19:55.704 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum install -y kernel 2024-04-25T09:19:58.623 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-04-25T09:19:58.978 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.0 MB 00:01 2024-04-25T09:20:00.891 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T09:20:01.657 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-25T09:20:05.083 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.2 MB 00:00 2024-04-25T09:20:05.830 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T09:20:06.634 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 16 kB 00:00 2024-04-25T09:20:07.713 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-25T09:20:08.994 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 21 MB 00:02 2024-04-25T09:20:09.473 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T09:20:14.077 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T09:20:14.548 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-04-25T09:20:15.975 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T09:20:15.975 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T09:20:16.068 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:20:16.069 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:20:16.069 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:20:16.178 DEBUG:teuthology.orchestra.run.smithi172:> echo no | sudo yum reinstall kernel || true 2024-04-25T09:20:16.428 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T09:20:16.429 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T09:20:16.522 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:20:16.523 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:20:16.523 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:20:16.638 DEBUG:teuthology.orchestra.run.smithi165:> echo no | sudo yum reinstall kernel || true 2024-04-25T09:20:16.686 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 09:20:14 AM UTC. 2024-04-25T09:20:16.806 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-25T09:20:16.816 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-25T09:20:16.817 INFO:teuthology.orchestra.run.smithi172.stderr:Operation aborted. 2024-04-25T09:20:16.877 INFO:teuthology.orchestra.run.smithi172.stdout:Is this ok [y/N]: 2024-04-25T09:20:16.877 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum reinstall -y kernel || true 2024-04-25T09:20:17.136 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 09:20:14 AM UTC. 2024-04-25T09:20:17.266 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:20:17.274 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout:Reinstalling: 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 255 k 2024-04-25T09:20:17.275 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 0 2024-04-25T09:20:17.276 INFO:teuthology.orchestra.run.smithi165.stderr:Operation aborted. 2024-04-25T09:20:17.335 INFO:teuthology.orchestra.run.smithi165.stdout:Is this ok [y/N]: 2024-04-25T09:20:17.336 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum reinstall -y kernel || true 2024-04-25T09:20:17.371 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 09:20:14 AM UTC. 2024-04-25T09:20:17.486 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:20:17.487 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:20:17.487 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-25T09:20:17.487 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:20:17.487 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-25T09:20:17.488 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:20:17.831 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 09:20:14 AM UTC. 2024-04-25T09:20:17.871 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64.rpm 953 kB/s | 255 kB 00:00 2024-04-25T09:20:17.871 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:20:17.871 INFO:teuthology.orchestra.run.smithi172.stdout:Total 666 kB/s | 255 kB 00:00 2024-04-25T09:20:17.890 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:20:17.947 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:20:17.948 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout:Reinstalling: 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:20:17.949 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:20:17.950 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 255 k 2024-04-25T09:20:17.950 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 0 2024-04-25T09:20:17.950 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:20:18.092 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:20:18.092 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:20:18.097 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:20:18.097 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:20:18.243 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:20:18.305 INFO:teuthology.orchestra.run.smithi172.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:20:18.305 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:20:18.324 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-437.el9.x86_64.rpm 994 kB/s | 255 kB 00:00 2024-04-25T09:20:18.325 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:20:18.325 INFO:teuthology.orchestra.run.smithi165.stdout:Total 679 kB/s | 255 kB 00:00 2024-04-25T09:20:18.340 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:20:18.524 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:20:18.524 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:20:18.529 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:20:18.529 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:20:18.678 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:20:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:20:18.742 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:20:19.098 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:20:19.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:20:19.361 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:20:19.361 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T09:20:19.853 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:20:19.853 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:20:19.853 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalled: 2024-04-25T09:20:19.853 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T09:20:19.853 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:20:19.853 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:20:20.024 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T09:20:20.066 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T09:20:20.066 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:20:20.066 INFO:teuthology.orchestra.run.smithi165.stdout:Reinstalled: 2024-04-25T09:20:20.066 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T09:20:20.067 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:20:20.067 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:20:20.070 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T09:20:20.071 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T09:20:20.071 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T09:20:20.072 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-25T09:20:20.072 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T09:20:20.111 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-04-25T09:20:20.135 DEBUG:teuthology.parallel:result is None 2024-04-25T09:20:20.239 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T09:20:20.286 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T09:20:20.286 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T09:20:20.286 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T09:20:20.286 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T09:20:20.286 DEBUG:teuthology.orchestra.run.smithi165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T09:20:20.317 INFO:teuthology.orchestra.run.smithi165.stdout:ttyS1 2024-04-25T09:20:20.342 DEBUG:teuthology.parallel:result is None 2024-04-25T09:20:20.343 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T09:20:20.350 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T09:20:20.350 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:20:20.385 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:20:20.400 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T09:20:20.407 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T09:20:20.485 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T09:20:20.485 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:20:20.487 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:20:20.517 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T09:20:20.524 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T09:20:20.524 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:20:20.555 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:20:20.584 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:20:20.593 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:20:20.595 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:20:20.604 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:20:20.606 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T09:20:20.613 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T09:20:20.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:20:20.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:20:20.672 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T09:20:20.681 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T09:20:20.681 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:20:20.712 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:20:20.727 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:20:20.808 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:20:20.854 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:20:20.936 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:20:20.974 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:20:20.975 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:20:21.038 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:20:21.079 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:20:21.137 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:20:21.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:20:21.258 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:20:21.258 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:20:21.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-04-25T09:20:21.324 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-04-25T09:20:21.353 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:20:21.409 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:20:21.727 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T09:20:21.736 INFO:teuthology.task.internal:Starting timer... 2024-04-25T09:20:21.736 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T09:20:21.749 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T09:20:21.758 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T09:20:21.759 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-04-25T09:20:21.824 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-04-25T09:20:21.826 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-04-25T09:20:21.901 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-04-25T09:20:21.903 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T09:20:21.903 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-04-25T09:20:21.925 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-04-25T09:20:21.925 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-04-25T09:20:21.942 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-04-25T09:20:21.942 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi165.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-04-25T09:20:21.942 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:20:21.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:20:21.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:20:22.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:20:22.018 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T09:20:22.018 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-04-25T09:20:22.055 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-04-25T09:20:22.082 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T09:20:22.091 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T09:20:22.097 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T09:20:22.323 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T09:20:22.340 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T09:20:22.341 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi165.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T09:23:50.672 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi165.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-04-25T09:23:50.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T09:23:50.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:23:50.759 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-04-25T09:23:50.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-04-25T09:23:50.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T09:23:50.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:23:50.914 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-25T09:23:50.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-25T09:23:50.955 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T09:23:50.966 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T09:23:50.966 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:23:50.967 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:23:50.969 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:23:50.970 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:23:50.993 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T09:23:51.006 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T09:23:51.022 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T09:23:51.029 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-04-25T09:23:51.035 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T09:23:51.039 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-04-25T09:23:51.052 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T09:23:51.058 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-04-25T09:23:51.065 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T09:23:51.068 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-04-25T09:23:51.081 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T09:23:51.094 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T09:23:51.119 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:23:51.124 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:23:51.124 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-04-25T09:23:51.124 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.124 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.124 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.124 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.149 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:23:51.154 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:23:51.154 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-25T09:23:51.154 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.154 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.154 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.154 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:23:51.154 INFO:teuthology.run_tasks:Running task install... 2024-04-25T09:23:51.163 DEBUG:teuthology.task.install:project ceph 2024-04-25T09:23:51.163 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}} 2024-04-25T09:23:51.163 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'} 2024-04-25T09:23:51.163 INFO:teuthology.task.install:Using flavor: crimson 2024-04-25T09:23:51.170 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T09:23:51.170 INFO:teuthology.task.install:extra packages: [] 2024-04-25T09:23:51.170 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'tag': None, 'wait_for_package': False} 2024-04-25T09:23:51.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:23:51.173 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'tag': None, 'wait_for_package': False} 2024-04-25T09:23:51.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:23:51.325 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/ 2024-04-25T09:23:51.325 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3194.ga126334d 2024-04-25T09:23:51.336 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/ 2024-04-25T09:23:51.336 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3194.ga126334d 2024-04-25T09:23:51.434 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T09:23:51.435 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:23:51.435 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T09:23:51.454 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-april-22/a126334d8733673d119ffdf40d6ae4b541a0a1cd/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T09:23:51.454 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:23:51.454 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T09:23:51.459 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T09:23:51.459 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a126334d8733673d119ffdf40d6ae4b541a0a1cd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T09:23:51.479 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T09:23:51.479 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a126334d8733673d119ffdf40d6ae4b541a0a1cd/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T09:23:51.523 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T09:23:51.544 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T09:23:51.596 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T09:23:51.617 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T09:23:51.659 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-04-25T09:23:51.660 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-04-25T09:23:51.680 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-04-25T09:23:51.681 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-04-25T09:23:51.887 INFO:teuthology.orchestra.run.smithi172.stdout:48 files removed 2024-04-25T09:23:51.907 INFO:teuthology.orchestra.run.smithi165.stdout:48 files removed 2024-04-25T09:23:51.914 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw 2024-04-25T09:23:51.934 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw 2024-04-25T09:23:52.535 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 243 kB/s | 87 kB 00:00 2024-04-25T09:23:52.541 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 251 kB/s | 87 kB 00:00 2024-04-25T09:23:52.911 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-04-25T09:23:52.917 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-04-25T09:23:53.243 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 7.0 kB/s | 2.0 kB 00:00 2024-04-25T09:23:53.278 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 6.1 kB/s | 2.0 kB 00:00 2024-04-25T09:23:54.584 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-04-25T09:23:54.837 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.0 MB 00:01 2024-04-25T09:23:58.536 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 19 MB 00:02 2024-04-25T09:23:58.729 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 19 MB 00:02 2024-04-25T09:24:02.914 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.2 MB 00:00 2024-04-25T09:24:03.311 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.2 MB 00:01 2024-04-25T09:24:04.356 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-04-25T09:24:04.770 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-04-25T09:24:06.560 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-25T09:24:11.633 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T09:24:13.420 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 2.5 MB/s | 21 MB 00:08 2024-04-25T09:24:13.813 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:24:13.815 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:24:13.815 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:24:13.815 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:24:13.815 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 10 M 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.7 M 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.9 M 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 19 M 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.0.0-3194.ga126334d.el9 ceph 25 k 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T09:24:13.816 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 796 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 548 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.3 M 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 45 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 135 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.0.0-3194.ga126334d.el9 ceph 160 k 2024-04-25T09:24:13.817 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.0.0-3194.ga126334d.el9 ceph 315 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 293 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 99 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:24:13.818 INFO:teuthology.orchestra.run.smithi172.stdout:Install 30 Packages 2024-04-25T09:24:13.819 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2024-04-25T09:24:13.819 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:13.819 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 59 M 2024-04-25T09:24:13.819 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:24:14.901 INFO:teuthology.orchestra.run.smithi172.stdout:(1/32): ceph-base-19.0.0-3194.ga126334d.el9.x86 7.1 MB/s | 5.9 MB 00:00 2024-04-25T09:24:14.951 INFO:teuthology.orchestra.run.smithi172.stdout:(2/32): ceph-selinux-19.0.0-3194.ga126334d.el9. 505 kB/s | 25 kB 00:00 2024-04-25T09:24:15.076 INFO:teuthology.orchestra.run.smithi172.stdout:(3/32): libcephfs2-19.0.0-3194.ga126334d.el9.x8 6.2 MB/s | 796 kB 00:00 2024-04-25T09:24:15.159 INFO:teuthology.orchestra.run.smithi172.stdout:(4/32): libradosstriper1-19.0.0-3194.ga126334d. 6.4 MB/s | 548 kB 00:00 2024-04-25T09:24:15.610 INFO:teuthology.orchestra.run.smithi172.stdout:(5/32): librgw2-19.0.0-3194.ga126334d.el9.x86_6 12 MB/s | 5.3 MB 00:00 2024-04-25T09:24:15.652 INFO:teuthology.orchestra.run.smithi172.stdout:(6/32): python3-ceph-argparse-19.0.0-3194.ga126 1.1 MB/s | 45 kB 00:00 2024-04-25T09:24:15.694 INFO:teuthology.orchestra.run.smithi172.stdout:(7/32): python3-ceph-common-19.0.0-3194.ga12633 3.2 MB/s | 135 kB 00:00 2024-04-25T09:24:15.802 INFO:teuthology.orchestra.run.smithi172.stdout:(8/32): ceph-radosgw-19.0.0-3194.ga126334d.el9. 5.8 MB/s | 10 MB 00:01 2024-04-25T09:24:15.827 INFO:teuthology.orchestra.run.smithi172.stdout:(9/32): python3-cephfs-19.0.0-3194.ga126334d.el 1.2 MB/s | 160 kB 00:00 2024-04-25T09:24:15.886 INFO:teuthology.orchestra.run.smithi172.stdout:(10/32): python3-rbd-19.0.0-3194.ga126334d.el9. 4.9 MB/s | 293 kB 00:00 2024-04-25T09:24:15.945 INFO:teuthology.orchestra.run.smithi172.stdout:(11/32): python3-rgw-19.0.0-3194.ga126334d.el9. 1.7 MB/s | 99 kB 00:00 2024-04-25T09:24:15.970 INFO:teuthology.orchestra.run.smithi172.stdout:(12/32): python3-rados-19.0.0-3194.ga126334d.el 1.8 MB/s | 315 kB 00:00 2024-04-25T09:24:16.320 INFO:teuthology.orchestra.run.smithi172.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 285 kB/s | 107 kB 00:00 2024-04-25T09:24:16.346 INFO:teuthology.orchestra.run.smithi172.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 427 kB/s | 160 kB 00:00 2024-04-25T09:24:16.637 INFO:teuthology.orchestra.run.smithi172.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 143 kB/s | 45 kB 00:00 2024-04-25T09:24:16.905 INFO:teuthology.orchestra.run.smithi172.stdout:(16/32): ceph-common-19.0.0-3194.ga126334d.el9. 6.8 MB/s | 19 MB 00:02 2024-04-25T09:24:17.021 INFO:teuthology.orchestra.run.smithi172.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 981 kB/s | 662 kB 00:00 2024-04-25T09:24:17.064 INFO:teuthology.orchestra.run.smithi172.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 687 kB/s | 292 kB 00:00 2024-04-25T09:24:17.088 INFO:teuthology.orchestra.run.smithi172.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 230 kB/s | 42 kB 00:00 2024-04-25T09:24:17.222 INFO:teuthology.orchestra.run.smithi172.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 226 kB/s | 36 kB 00:00 2024-04-25T09:24:17.325 INFO:teuthology.orchestra.run.smithi172.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 728 kB/s | 221 kB 00:00 2024-04-25T09:24:18.267 INFO:teuthology.orchestra.run.smithi172.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 296 kB/s | 309 kB 00:01 2024-04-25T09:24:18.326 INFO:teuthology.orchestra.run.smithi172.stdout:(23/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 38 kB/s | 47 kB 00:01 2024-04-25T09:24:18.384 INFO:teuthology.orchestra.run.smithi172.stdout:(24/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 221 kB/s | 26 kB 00:00 2024-04-25T09:24:18.562 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-25T09:24:18.593 INFO:teuthology.orchestra.run.smithi172.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 324 kB/s | 67 kB 00:00 2024-04-25T09:24:18.943 INFO:teuthology.orchestra.run.smithi172.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 79 kB/s | 49 kB 00:00 2024-04-25T09:24:19.343 INFO:teuthology.orchestra.run.smithi172.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 479 kB/s | 192 kB 00:00 2024-04-25T09:24:19.793 INFO:teuthology.orchestra.run.smithi172.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 698 kB/s | 838 kB 00:01 2024-04-25T09:24:20.069 INFO:teuthology.orchestra.run.smithi172.stdout:(29/32): librados2-19.0.0-3194.ga126334d.el9.x8 12 MB/s | 3.4 MB 00:00 2024-04-25T09:24:20.261 INFO:teuthology.orchestra.run.smithi172.stdout:(30/32): librbd1-19.0.0-3194.ga126334d.el9.x86_ 19 MB/s | 3.7 MB 00:00 2024-04-25T09:24:20.729 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:24:20.731 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 10 M 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.7 M 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.9 M 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 19 M 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.0.0-3194.ga126334d.el9 ceph 25 k 2024-04-25T09:24:20.732 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 796 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 548 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.3 M 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T09:24:20.733 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 45 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.0.0-3194.ga126334d.el9 ceph 135 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.0.0-3194.ga126334d.el9 ceph 160 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.0.0-3194.ga126334d.el9 ceph 315 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 293 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.0.0-3194.ga126334d.el9 ceph 99 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T09:24:20.734 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:20.735 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:24:20.735 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:24:20.735 INFO:teuthology.orchestra.run.smithi165.stdout:Install 30 Packages 2024-04-25T09:24:20.735 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 2 Packages 2024-04-25T09:24:20.735 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:20.735 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 59 M 2024-04-25T09:24:20.735 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:24:21.477 INFO:teuthology.orchestra.run.smithi172.stdout:(31/32): thrift-0.15.0-2.el9.x86_64.rpm 759 kB/s | 1.6 MB 00:02 2024-04-25T09:24:22.131 INFO:teuthology.orchestra.run.smithi165.stdout:(1/32): ceph-base-19.0.0-3194.ga126334d.el9.x86 6.4 MB/s | 5.9 MB 00:00 2024-04-25T09:24:22.165 INFO:teuthology.orchestra.run.smithi165.stdout:(2/32): ceph-selinux-19.0.0-3194.ga126334d.el9. 760 kB/s | 25 kB 00:00 2024-04-25T09:24:22.298 INFO:teuthology.orchestra.run.smithi165.stdout:(3/32): libcephfs2-19.0.0-3194.ga126334d.el9.x8 5.8 MB/s | 796 kB 00:00 2024-04-25T09:24:22.399 INFO:teuthology.orchestra.run.smithi165.stdout:(4/32): libradosstriper1-19.0.0-3194.ga126334d. 5.4 MB/s | 548 kB 00:00 2024-04-25T09:24:22.499 INFO:teuthology.orchestra.run.smithi165.stdout:(5/32): ceph-radosgw-19.0.0-3194.ga126334d.el9. 7.8 MB/s | 10 MB 00:01 2024-04-25T09:24:22.549 INFO:teuthology.orchestra.run.smithi165.stdout:(6/32): python3-ceph-argparse-19.0.0-3194.ga126 905 kB/s | 45 kB 00:00 2024-04-25T09:24:22.607 INFO:teuthology.orchestra.run.smithi165.stdout:(7/32): python3-ceph-common-19.0.0-3194.ga12633 2.3 MB/s | 135 kB 00:00 2024-04-25T09:24:22.674 INFO:teuthology.orchestra.run.smithi165.stdout:(8/32): python3-cephfs-19.0.0-3194.ga126334d.el 2.3 MB/s | 160 kB 00:00 2024-04-25T09:24:22.750 INFO:teuthology.orchestra.run.smithi165.stdout:(9/32): python3-rados-19.0.0-3194.ga126334d.el9 4.1 MB/s | 315 kB 00:00 2024-04-25T09:24:22.825 INFO:teuthology.orchestra.run.smithi165.stdout:(10/32): librgw2-19.0.0-3194.ga126334d.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-04-25T09:24:22.850 INFO:teuthology.orchestra.run.smithi165.stdout:(11/32): python3-rbd-19.0.0-3194.ga126334d.el9. 2.9 MB/s | 293 kB 00:00 2024-04-25T09:24:22.875 INFO:teuthology.orchestra.run.smithi165.stdout:(12/32): python3-rgw-19.0.0-3194.ga126334d.el9. 1.9 MB/s | 99 kB 00:00 2024-04-25T09:24:23.275 INFO:teuthology.orchestra.run.smithi165.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 251 kB/s | 107 kB 00:00 2024-04-25T09:24:23.301 INFO:teuthology.orchestra.run.smithi165.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 377 kB/s | 160 kB 00:00 2024-04-25T09:24:23.651 INFO:teuthology.orchestra.run.smithi165.stdout:(15/32): ceph-common-19.0.0-3194.ga126334d.el9. 7.9 MB/s | 19 MB 00:02 2024-04-25T09:24:23.676 INFO:teuthology.orchestra.run.smithi165.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 113 kB/s | 45 kB 00:00 2024-04-25T09:24:23.977 INFO:teuthology.orchestra.run.smithi172.stdout:(32/32): libarrow-9.0.0-10.el9.x86_64.rpm 683 kB/s | 4.4 MB 00:06 2024-04-25T09:24:23.983 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:24:23.983 INFO:teuthology.orchestra.run.smithi172.stdout:Total 5.8 MB/s | 59 MB 00:10 2024-04-25T09:24:24.018 INFO:teuthology.orchestra.run.smithi165.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 124 kB/s | 42 kB 00:00 2024-04-25T09:24:24.087 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:24:24.124 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:24:24.125 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:24:24.177 INFO:teuthology.orchestra.run.smithi165.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 756 kB/s | 662 kB 00:00 2024-04-25T09:24:24.385 INFO:teuthology.orchestra.run.smithi165.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 398 kB/s | 292 kB 00:00 2024-04-25T09:24:24.435 INFO:teuthology.orchestra.run.smithi165.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 139 kB/s | 36 kB 00:00 2024-04-25T09:24:24.586 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:24:24.587 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:24:24.728 INFO:teuthology.orchestra.run.smithi165.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-04-25T09:24:24.828 INFO:teuthology.orchestra.run.smithi165.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 273 kB/s | 221 kB 00:00 2024-04-25T09:24:24.886 INFO:teuthology.orchestra.run.smithi165.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 686 kB/s | 309 kB 00:00 2024-04-25T09:24:24.995 INFO:teuthology.orchestra.run.smithi165.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 596 kB/s | 49 kB 00:00 2024-04-25T09:24:25.078 INFO:teuthology.orchestra.run.smithi165.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 808 kB/s | 67 kB 00:00 2024-04-25T09:24:25.103 INFO:teuthology.orchestra.run.smithi165.stdout:(26/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 94 kB/s | 26 kB 00:00 2024-04-25T09:24:25.262 INFO:teuthology.orchestra.run.smithi165.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-25T09:24:25.329 INFO:teuthology.orchestra.run.smithi165.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 851 kB/s | 192 kB 00:00 2024-04-25T09:24:25.405 INFO:teuthology.orchestra.run.smithi165.stdout:(29/32): libarrow-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-04-25T09:24:25.447 INFO:teuthology.orchestra.run.smithi165.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-25T09:24:25.714 INFO:teuthology.orchestra.run.smithi165.stdout:(31/32): librados2-19.0.0-3194.ga126334d.el9.x8 8.8 MB/s | 3.4 MB 00:00 2024-04-25T09:24:25.789 INFO:teuthology.orchestra.run.smithi165.stdout:(32/32): librbd1-19.0.0-3194.ga126334d.el9.x86_ 9.6 MB/s | 3.7 MB 00:00 2024-04-25T09:24:25.795 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:24:25.795 INFO:teuthology.orchestra.run.smithi165.stdout:Total 12 MB/s | 59 MB 00:05 2024-04-25T09:24:25.901 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:24:25.939 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:24:25.939 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:24:26.059 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:24:26.403 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:24:26.403 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:24:26.613 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-25T09:24:26.713 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:24:26.804 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:24:26.893 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:24:26.932 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:24:26.994 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:24:27.031 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-25T09:24:27.061 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-25T09:24:27.086 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-25T09:24:27.110 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:24:27.129 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:24:27.326 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:24:27.359 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:24:27.709 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-25T09:24:27.763 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:24:27.830 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:24:27.873 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 12/34 2024-04-25T09:24:27.894 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:24:27.928 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:24:27.961 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 14/34 2024-04-25T09:24:28.058 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-25T09:24:28.101 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:24:28.188 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:24:28.223 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-25T09:24:28.335 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-25T09:24:28.366 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-25T09:24:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-25T09:24:28.431 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-25T09:24:28.450 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-25T09:24:28.460 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-25T09:24:28.491 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-25T09:24:28.499 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:24:28.527 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-25T09:24:28.591 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:24:28.679 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:24:28.709 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:24:28.772 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:24:28.809 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-25T09:24:28.838 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-25T09:24:28.864 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-25T09:24:28.886 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:24:28.905 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-25T09:24:29.054 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:24:29.086 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-25T09:24:29.104 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-25T09:24:29.148 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:24:29.227 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:24:29.305 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 27/34 2024-04-25T09:24:29.334 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 28/34 2024-04-25T09:24:29.449 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-25T09:24:29.499 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:24:29.741 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:24:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 12/34 2024-04-25T09:24:29.839 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:24:29.871 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 14/34 2024-04-25T09:24:29.959 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-25T09:24:29.984 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:24:30.067 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 16/34 2024-04-25T09:24:30.100 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-25T09:24:30.211 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-25T09:24:30.242 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-25T09:24:30.282 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-25T09:24:30.307 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-25T09:24:30.337 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-25T09:24:30.367 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-25T09:24:30.403 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-25T09:24:30.971 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-25T09:24:30.999 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:24:31.069 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 26/34 2024-04-25T09:24:31.138 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 27/34 2024-04-25T09:24:31.167 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 28/34 2024-04-25T09:24:31.822 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:24:31.855 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:24:32.518 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:24:32.559 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:24:32.651 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:24:32.651 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T09:24:32.651 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T09:24:32.651 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:32.685 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:24:33.575 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:24:33.613 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:24:34.276 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 29/34 2024-04-25T09:24:34.307 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:24:34.400 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 30/34 2024-04-25T09:24:34.400 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T09:24:34.400 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T09:24:34.400 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:34.434 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:24:42.430 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:24:42.430 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-04-25T09:24:42.430 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-04-25T09:24:42.430 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-04-25T09:24:42.430 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-04-25T09:24:42.430 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-04-25T09:24:42.430 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-04-25T09:24:42.431 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-04-25T09:24:42.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:43.467 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:24:43.493 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:24:43.493 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:24:43.493 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T09:24:43.493 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:24:43.493 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:24:43.493 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:43.495 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:24:43.578 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:24:43.579 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-04-25T09:24:44.169 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 1/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 5/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 6/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 7/34 2024-04-25T09:24:44.961 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 8/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 9/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 10/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 12/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-25T09:24:44.962 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-25T09:24:44.963 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 33/34 2024-04-25T09:24:45.257 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:24:45.281 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 32/34 2024-04-25T09:24:45.281 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:24:45.282 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T09:24:45.282 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:24:45.282 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:24:45.282 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:45.284 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:24:45.359 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-25T09:24:45.360 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-04-25T09:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:24:45.773 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T09:24:45.774 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:45.775 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T09:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T09:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T09:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T09:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T09:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:45.776 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:24:46.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-test 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 1/34 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2/34 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 3/34 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 4/34 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 5/34 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_6 6/34 2024-04-25T09:24:46.554 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 7/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9. 8/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x8 9/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 10/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 11/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 12/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 13/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-25T09:24:46.555 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.0.0-3194.ga126334d.el9.x86_64 31/34 2024-04-25T09:24:46.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-25T09:24:46.557 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 33/34 2024-04-25T09:24:46.640 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:35 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:24:46.763 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:24:46.764 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.0.0-3194.ga126334d.el9 ceph 84 M 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.0.0-3194.ga126334d.el9 ceph 173 k 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-25T09:24:46.765 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout:Install 9 Packages 2024-04-25T09:24:46.766 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:24:46.767 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 87 M 2024-04-25T09:24:46.767 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 813 M 2024-04-25T09:24:46.767 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:24:47.316 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-25T09:24:47.316 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:47.316 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-04-25T09:24:47.316 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T09:24:47.317 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.318 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:47.319 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:24:47.577 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-test 2024-04-25T09:24:47.586 INFO:teuthology.orchestra.run.smithi172.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 538 kB/s | 94 kB 00:00 2024-04-25T09:24:47.713 INFO:teuthology.orchestra.run.smithi172.stdout:(2/9): libcephsqlite-19.0.0-3194.ga126334d.el9. 575 kB/s | 173 kB 00:00 2024-04-25T09:24:47.806 INFO:teuthology.orchestra.run.smithi172.stdout:(3/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 2.1 MB/s | 469 kB 00:00 2024-04-25T09:24:47.915 INFO:teuthology.orchestra.run.smithi172.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 9.2 MB/s | 1.0 MB 00:00 2024-04-25T09:24:47.965 INFO:teuthology.orchestra.run.smithi172.stdout:(5/9): libubsan-11.4.1-3.el9.x86_64.rpm 741 kB/s | 187 kB 00:00 2024-04-25T09:24:48.033 INFO:teuthology.orchestra.run.smithi172.stdout:(6/9): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 305 kB 00:00 2024-04-25T09:24:48.075 INFO:teuthology.orchestra.run.smithi172.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 584 kB/s | 64 kB 00:00 2024-04-25T09:24:48.114 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:30 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:24:48.237 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:24:48.238 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:24:48.238 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:24:48.238 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:24:48.238 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:24:48.238 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.0.0-3194.ga126334d.el9 ceph 84 M 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.0.0-3194.ga126334d.el9 ceph 173 k 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:24:48.239 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:24:48.240 INFO:teuthology.orchestra.run.smithi165.stdout:Install 9 Packages 2024-04-25T09:24:48.240 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:24:48.240 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 87 M 2024-04-25T09:24:48.240 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 813 M 2024-04-25T09:24:48.240 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:24:48.512 INFO:teuthology.orchestra.run.smithi172.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 255 kB/s | 122 kB 00:00 2024-04-25T09:24:49.121 INFO:teuthology.orchestra.run.smithi165.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 669 kB/s | 94 kB 00:00 2024-04-25T09:24:49.247 INFO:teuthology.orchestra.run.smithi165.stdout:(2/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 3.7 MB/s | 469 kB 00:00 2024-04-25T09:24:49.297 INFO:teuthology.orchestra.run.smithi165.stdout:(3/9): libubsan-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2024-04-25T09:24:49.400 INFO:teuthology.orchestra.run.smithi165.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-25T09:24:49.483 INFO:teuthology.orchestra.run.smithi165.stdout:(5/9): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-04-25T09:24:49.524 INFO:teuthology.orchestra.run.smithi165.stdout:(6/9): libcephsqlite-19.0.0-3194.ga126334d.el9. 318 kB/s | 173 kB 00:00 2024-04-25T09:24:49.560 INFO:teuthology.orchestra.run.smithi165.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 834 kB/s | 64 kB 00:00 2024-04-25T09:24:49.684 INFO:teuthology.orchestra.run.smithi165.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 764 kB/s | 122 kB 00:00 2024-04-25T09:24:52.495 INFO:teuthology.orchestra.run.smithi172.stdout:(9/9): ceph-test-19.0.0-3194.ga126334d.el9.x86_ 17 MB/s | 84 MB 00:05 2024-04-25T09:24:52.497 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:24:52.497 INFO:teuthology.orchestra.run.smithi172.stdout:Total 15 MB/s | 87 MB 00:05 2024-04-25T09:24:52.578 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:24:52.601 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:24:52.601 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:24:53.196 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:24:53.196 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:24:54.066 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:24:54.135 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-25T09:24:54.180 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-25T09:24:54.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-25T09:24:54.259 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-25T09:24:54.290 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:24:54.340 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:24:54.409 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:24:54.457 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-25T09:24:54.484 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:25:05.823 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:25:05.905 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:25:09.126 INFO:teuthology.orchestra.run.smithi165.stdout:(9/9): ceph-test-19.0.0-3194.ga126334d.el9.x86_ 4.2 MB/s | 84 MB 00:20 2024-04-25T09:25:09.128 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:25:09.128 INFO:teuthology.orchestra.run.smithi165.stdout:Total 4.2 MB/s | 87 MB 00:20 2024-04-25T09:25:09.209 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:25:09.233 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:25:09.233 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:25:09.858 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:25:09.859 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:25:10.752 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:25:10.825 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-25T09:25:10.869 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-25T09:25:10.913 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-25T09:25:10.940 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-25T09:25:10.970 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:25:10.996 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:25:11.064 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-25T09:25:11.104 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-25T09:25:11.130 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:25:12.179 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:25:12.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 1/9 2024-04-25T09:25:12.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2/9 2024-04-25T09:25:12.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-25T09:25:12.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-25T09:25:12.179 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:25:12.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-25T09:25:12.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-25T09:25:12.180 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-25T09:25:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-25T09:25:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:12.570 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:25:12.570 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:12.571 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:25:12.842 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph 2024-04-25T09:25:13.352 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:02 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:25:13.476 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.0.0-3194.ga126334d.el9 ceph 6.5 k 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.0.0-3194.ga126334d.el9 ceph 2.2 M 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.0.0-3194.ga126334d.el9 ceph 1.6 M 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 249 k 2024-04-25T09:25:13.479 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.0 M 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 71 M 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections 2024-04-25T09:25:13.480 INFO:teuthology.orchestra.run.smithi172.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T09:25:13.481 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout:Install 36 Packages 2024-04-25T09:25:13.482 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:13.483 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 85 M 2024-04-25T09:25:13.483 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 923 M 2024-04-25T09:25:13.483 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:25:14.234 INFO:teuthology.orchestra.run.smithi172.stdout:(1/36): ceph-19.0.0-3194.ga126334d.el9.x86_64.r 39 kB/s | 6.5 kB 00:00 2024-04-25T09:25:14.484 INFO:teuthology.orchestra.run.smithi172.stdout:(2/36): ceph-mgr-19.0.0-3194.ga126334d.el9.x86_ 3.7 MB/s | 1.6 MB 00:00 2024-04-25T09:25:14.534 INFO:teuthology.orchestra.run.smithi172.stdout:(3/36): ceph-mds-19.0.0-3194.ga126334d.el9.x86_ 4.7 MB/s | 2.2 MB 00:00 2024-04-25T09:25:14.635 INFO:teuthology.orchestra.run.smithi172.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3194.ga126 2.4 MB/s | 249 kB 00:00 2024-04-25T09:25:14.810 INFO:teuthology.orchestra.run.smithi172.stdout:(5/36): ceph-mon-19.0.0-3194.ga126334d.el9.x86_ 8.7 MB/s | 5.0 MB 00:00 2024-04-25T09:25:14.927 INFO:teuthology.orchestra.run.smithi172.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-04-25T09:25:15.144 INFO:teuthology.orchestra.run.smithi172.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 492 kB/s | 106 kB 00:00 2024-04-25T09:25:15.194 INFO:teuthology.orchestra.run.smithi172.stdout:(8/36): python3-cryptography-36.0.1-4.el9.x86_6 3.2 MB/s | 1.2 MB 00:00 2024-04-25T09:25:15.370 INFO:teuthology.orchestra.run.smithi172.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 600 kB/s | 135 kB 00:00 2024-04-25T09:25:15.445 INFO:teuthology.orchestra.run.smithi172.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 498 kB/s | 125 kB 00:00 2024-04-25T09:25:15.612 INFO:teuthology.orchestra.run.smithi172.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-04-25T09:25:15.662 INFO:teuthology.orchestra.run.smithi172.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T09:25:15.688 INFO:teuthology.orchestra.run.smithi172.stdout:(13/36): python3-urllib3-1.26.5-5.el9.noarch.rp 676 kB/s | 215 kB 00:00 2024-04-25T09:25:15.713 INFO:teuthology.orchestra.run.smithi172.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 689 kB/s | 35 kB 00:00 2024-04-25T09:25:15.763 INFO:teuthology.orchestra.run.smithi172.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-04-25T09:25:15.805 INFO:teuthology.orchestra.run.smithi172.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-04-25T09:25:15.830 INFO:teuthology.orchestra.run.smithi172.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 333 kB/s | 22 kB 00:00 2024-04-25T09:25:16.022 INFO:teuthology.orchestra.run.smithi172.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 226 kB/s | 43 kB 00:00 2024-04-25T09:25:16.047 INFO:teuthology.orchestra.run.smithi172.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 624 kB/s | 151 kB 00:00 2024-04-25T09:25:16.089 INFO:teuthology.orchestra.run.smithi172.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-25T09:25:16.115 INFO:teuthology.orchestra.run.smithi172.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 5.2 MB/s | 358 kB 00:00 2024-04-25T09:25:16.132 INFO:teuthology.orchestra.run.smithi172.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 258 kB/s | 11 kB 00:00 2024-04-25T09:25:16.149 INFO:teuthology.orchestra.run.smithi172.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 525 kB/s | 18 kB 00:00 2024-04-25T09:25:16.166 INFO:teuthology.orchestra.run.smithi172.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 687 kB/s | 23 kB 00:00 2024-04-25T09:25:16.191 INFO:teuthology.orchestra.run.smithi172.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 465 kB/s | 19 kB 00:00 2024-04-25T09:25:16.208 INFO:teuthology.orchestra.run.smithi172.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 468 kB/s | 20 kB 00:00 2024-04-25T09:25:16.250 INFO:teuthology.orchestra.run.smithi172.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 788 kB/s | 46 kB 00:00 2024-04-25T09:25:16.276 INFO:teuthology.orchestra.run.smithi172.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-04-25T09:25:16.301 INFO:teuthology.orchestra.run.smithi172.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-04-25T09:25:16.318 INFO:teuthology.orchestra.run.smithi172.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 397 kB/s | 16 kB 00:00 2024-04-25T09:25:16.360 INFO:teuthology.orchestra.run.smithi172.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-04-25T09:25:16.393 INFO:teuthology.orchestra.run.smithi172.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 472 kB/s | 36 kB 00:00 2024-04-25T09:25:16.419 INFO:teuthology.orchestra.run.smithi172.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-25T09:25:16.444 INFO:teuthology.orchestra.run.smithi172.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.4 MB/s | 427 kB 00:00 2024-04-25T09:25:16.469 INFO:teuthology.orchestra.run.smithi172.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 401 kB/s | 20 kB 00:00 2024-04-25T09:25:17.720 INFO:teuthology.orchestra.run.smithi172.stdout:(36/36): ceph-osd-19.0.0-3194.ga126334d.el9.x86 22 MB/s | 71 MB 00:03 2024-04-25T09:25:17.724 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:25:17.724 INFO:teuthology.orchestra.run.smithi172.stdout:Total 20 MB/s | 85 MB 00:04 2024-04-25T09:25:17.863 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:25:17.904 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:25:17.905 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:25:18.519 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:25:18.521 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:25:20.093 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:25:20.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-25T09:25:20.204 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-25T09:25:20.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-25T09:25:20.303 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-25T09:25:20.390 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-25T09:25:20.423 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-25T09:25:20.515 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-25T09:25:20.585 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-25T09:25:20.634 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-25T09:25:20.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-25T09:25:20.707 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-25T09:25:20.742 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-25T09:25:20.775 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-25T09:25:20.816 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-25T09:25:20.862 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-25T09:25:20.894 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-25T09:25:20.931 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-25T09:25:21.005 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-25T09:25:21.159 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-25T09:25:21.248 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-25T09:25:21.310 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-25T09:25:21.374 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-25T09:25:21.423 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-25T09:25:21.477 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-25T09:25:21.664 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-25T09:25:21.711 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-25T09:25:21.798 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-25T09:25:21.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-25T09:25:21.927 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-25T09:25:22.044 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-25T09:25:22.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 31/36 2024-04-25T09:25:22.263 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:25:22.288 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:25:22.288 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:22.288 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T09:25:22.288 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:25:22.288 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:25:22.289 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 8/9 2024-04-25T09:25:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:25:28.484 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 9/9 2024-04-25T09:25:28.484 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 1/9 2024-04-25T09:25:28.484 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2/9 2024-04-25T09:25:28.485 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-25T09:25:28.485 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-25T09:25:28.485 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-25T09:25:28.485 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-25T09:25:28.485 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-25T09:25:28.485 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-25T09:25:28.840 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:28.841 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:25:29.137 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph 2024-04-25T09:25:29.657 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:11 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:25:29.780 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.0.0-3194.ga126334d.el9 ceph 6.5 k 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.0.0-3194.ga126334d.el9 ceph 2.2 M 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.0.0-3194.ga126334d.el9 ceph 1.6 M 2024-04-25T09:25:29.783 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 249 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.0.0-3194.ga126334d.el9 ceph 5.0 M 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 71 M 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T09:25:29.784 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T09:25:29.785 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T09:25:29.786 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T09:25:29.787 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:29.787 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:25:29.787 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:25:29.787 INFO:teuthology.orchestra.run.smithi165.stdout:Install 36 Packages 2024-04-25T09:25:29.787 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:29.787 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 85 M 2024-04-25T09:25:29.788 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 923 M 2024-04-25T09:25:29.788 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:25:30.903 INFO:teuthology.orchestra.run.smithi165.stdout:(1/36): ceph-19.0.0-3194.ga126334d.el9.x86_64.r 17 kB/s | 6.5 kB 00:00 2024-04-25T09:25:31.978 INFO:teuthology.orchestra.run.smithi165.stdout:(2/36): ceph-mds-19.0.0-3194.ga126334d.el9.x86_ 1.5 MB/s | 2.2 MB 00:01 2024-04-25T09:25:32.045 INFO:teuthology.orchestra.run.smithi165.stdout:(3/36): ceph-mgr-19.0.0-3194.ga126334d.el9.x86_ 1.0 MB/s | 1.6 MB 00:01 2024-04-25T09:25:32.112 INFO:teuthology.orchestra.run.smithi165.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3194.ga126 3.7 MB/s | 249 kB 00:00 2024-04-25T09:25:32.504 INFO:teuthology.orchestra.run.smithi165.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 646 kB/s | 253 kB 00:00 2024-04-25T09:25:32.696 INFO:teuthology.orchestra.run.smithi165.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 6.4 MB/s | 1.2 MB 00:00 2024-04-25T09:25:32.780 INFO:teuthology.orchestra.run.smithi165.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-04-25T09:25:32.871 INFO:teuthology.orchestra.run.smithi165.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.4 MB/s | 135 kB 00:00 2024-04-25T09:25:32.947 INFO:teuthology.orchestra.run.smithi165.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-04-25T09:25:33.088 INFO:teuthology.orchestra.run.smithi165.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-04-25T09:25:33.162 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:25:33.164 INFO:teuthology.orchestra.run.smithi165.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-25T09:25:33.188 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:25:33.189 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:33.189 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T09:25:33.189 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:25:33.189 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:25:33.189 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:33.248 INFO:teuthology.orchestra.run.smithi165.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-25T09:25:33.331 INFO:teuthology.orchestra.run.smithi165.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 418 kB/s | 35 kB 00:00 2024-04-25T09:25:33.415 INFO:teuthology.orchestra.run.smithi165.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 613 kB/s | 51 kB 00:00 2024-04-25T09:25:33.498 INFO:teuthology.orchestra.run.smithi165.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 501 kB/s | 42 kB 00:00 2024-04-25T09:25:33.699 INFO:teuthology.orchestra.run.smithi165.stdout:(16/36): ceph-mon-19.0.0-3194.ga126334d.el9.x86 1.8 MB/s | 5.0 MB 00:02 2024-04-25T09:25:33.721 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:25:33.740 INFO:teuthology.orchestra.run.smithi165.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 92 kB/s | 22 kB 00:00 2024-04-25T09:25:33.744 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:25:33.744 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:33.745 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T09:25:33.745 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:25:33.745 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:25:33.745 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:33.907 INFO:teuthology.orchestra.run.smithi165.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 261 kB/s | 43 kB 00:00 2024-04-25T09:25:33.980 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:25:33.991 INFO:teuthology.orchestra.run.smithi165.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 518 kB/s | 151 kB 00:00 2024-04-25T09:25:34.003 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:25:34.003 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:34.003 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T09:25:34.003 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:25:34.003 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:25:34.003 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:34.066 INFO:teuthology.orchestra.run.smithi165.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-25T09:25:34.067 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:25:34.125 INFO:teuthology.orchestra.run.smithi165.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-04-25T09:25:34.150 INFO:teuthology.orchestra.run.smithi165.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-04-25T09:25:34.175 INFO:teuthology.orchestra.run.smithi165.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-04-25T09:25:34.201 INFO:teuthology.orchestra.run.smithi165.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 463 kB/s | 23 kB 00:00 2024-04-25T09:25:34.234 INFO:teuthology.orchestra.run.smithi165.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 332 kB/s | 19 kB 00:00 2024-04-25T09:25:34.259 INFO:teuthology.orchestra.run.smithi165.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2024-04-25T09:25:34.285 INFO:teuthology.orchestra.run.smithi165.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-04-25T09:25:34.310 INFO:teuthology.orchestra.run.smithi165.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-04-25T09:25:34.360 INFO:teuthology.orchestra.run.smithi165.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 329 kB/s | 16 kB 00:00 2024-04-25T09:25:34.385 INFO:teuthology.orchestra.run.smithi165.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-04-25T09:25:34.411 INFO:teuthology.orchestra.run.smithi165.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-04-25T09:25:34.436 INFO:teuthology.orchestra.run.smithi165.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-04-25T09:25:34.470 INFO:teuthology.orchestra.run.smithi165.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-04-25T09:25:34.511 INFO:teuthology.orchestra.run.smithi165.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-04-25T09:25:34.537 INFO:teuthology.orchestra.run.smithi165.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 299 kB/s | 20 kB 00:00 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 1/36 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2/36 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 3/36 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 4/36 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 5/36 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 6/36 2024-04-25T09:25:40.782 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-25T09:25:40.783 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-25T09:25:40.784 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-25T09:25:40.787 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-25T09:25:40.787 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-25T09:25:40.787 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-25T09:25:40.787 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-25T09:25:40.787 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-25T09:25:40.788 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-25T09:25:41.378 INFO:teuthology.orchestra.run.smithi165.stdout:(36/36): ceph-osd-19.0.0-3194.ga126334d.el9.x86 7.6 MB/s | 71 MB 00:09 2024-04-25T09:25:41.380 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:25:41.381 INFO:teuthology.orchestra.run.smithi165.stdout:Total 7.3 MB/s | 85 MB 00:11 2024-04-25T09:25:41.518 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:25:41.559 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:25:41.559 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:25:41.669 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T09:25:41.670 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T09:25:41.671 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T09:25:41.672 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:41.673 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:25:42.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-base 2024-04-25T09:25:42.172 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:25:42.172 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:25:42.550 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:31 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:25:42.631 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:25:42.675 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:25:42.676 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:25:42.676 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:25:42.744 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install cephadm 2024-04-25T09:25:43.281 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:32 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:25:43.406 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:25:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:43.407 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:25:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:25:43.407 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 762 k 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 762 k 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 769 k 2024-04-25T09:25:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:25:43.732 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:25:43.797 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-25T09:25:43.829 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-25T09:25:43.857 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-25T09:25:43.927 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-25T09:25:43.964 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-25T09:25:43.997 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-25T09:25:44.022 INFO:teuthology.orchestra.run.smithi172.stdout:cephadm-19.0.0-3194.ga126334d.el9.noarch.rpm 1.2 MB/s | 762 kB 00:00 2024-04-25T09:25:44.022 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:25:44.023 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.2 MB/s | 762 kB 00:00 2024-04-25T09:25:44.023 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:25:44.028 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:25:44.029 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:25:44.034 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:25:44.035 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:25:44.090 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-25T09:25:44.107 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:25:44.176 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-25T09:25:44.216 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-25T09:25:44.251 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-25T09:25:44.281 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-25T09:25:44.307 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-25T09:25:44.331 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-25T09:25:44.373 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-25T09:25:44.416 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-25T09:25:44.450 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-25T09:25:44.488 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-25T09:25:44.562 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-25T09:25:44.582 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:25:44.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:25:44.701 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-25T09:25:44.780 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-25T09:25:44.833 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-25T09:25:44.870 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-25T09:25:44.919 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-25T09:25:44.991 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-25T09:25:45.027 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:25:45.175 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-25T09:25:45.224 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-25T09:25:45.273 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:25:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:45.274 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:25:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:25:45.274 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:45.274 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:25:45.293 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-25T09:25:45.382 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-25T09:25:45.423 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-25T09:25:45.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T09:25:45.538 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-25T09:25:45.731 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 31/36 2024-04-25T09:25:45.759 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:25:45.783 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 32/36 2024-04-25T09:25:45.783 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:45.783 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T09:25:45.783 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:25:45.783 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T09:25:45.783 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:46.056 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:25:46.178 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:25:46.179 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:46.179 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-04-25T09:25:46.179 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3194.ga126334d.el9 ceph 157 k 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 157 k 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 640 k 2024-04-25T09:25:46.180 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:25:46.871 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-immutable-object-cache-19.0.0-3194.ga12633 227 kB/s | 157 kB 00:00 2024-04-25T09:25:46.872 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:25:46.872 INFO:teuthology.orchestra.run.smithi172.stdout:Total 227 kB/s | 157 kB 00:00 2024-04-25T09:25:46.872 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:25:46.882 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:25:46.882 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:25:46.940 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:25:46.940 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:25:47.085 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:25:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:25:47.205 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:25:47.205 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:47.205 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T09:25:47.205 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:25:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:48.081 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:25:48.081 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:25:48.082 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:48.082 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:25:48.298 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr 2024-04-25T09:25:48.817 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:37 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:25:48.897 INFO:teuthology.orchestra.run.smithi172.stdout:Package ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:25:48.940 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:25:48.941 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:25:48.941 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:25:49.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T09:25:49.551 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:38 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:25:49.673 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:25:49.674 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:25:49.674 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:49.674 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:25:49.674 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 3.5 M 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 34 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 16 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:49.675 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:Install 11 Packages 2024-04-25T09:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 7.6 M 2024-04-25T09:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 100 M 2024-04-25T09:25:49.676 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:25:50.359 INFO:teuthology.orchestra.run.smithi172.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3194.ga1 178 kB/s | 34 kB 00:00 2024-04-25T09:25:50.393 INFO:teuthology.orchestra.run.smithi172.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3194.ga12 73 kB/s | 16 kB 00:00 2024-04-25T09:25:50.610 INFO:teuthology.orchestra.run.smithi172.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-04-25T09:25:50.710 INFO:teuthology.orchestra.run.smithi172.stdout:(4/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-04-25T09:25:50.952 INFO:teuthology.orchestra.run.smithi172.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-04-25T09:25:51.211 INFO:teuthology.orchestra.run.smithi172.stdout:(6/11): ceph-mgr-dashboard-19.0.0-3194.ga126334 3.4 MB/s | 3.5 MB 00:01 2024-04-25T09:25:51.236 INFO:teuthology.orchestra.run.smithi172.stdout:(7/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 876 kB/s | 548 kB 00:00 2024-04-25T09:25:51.336 INFO:teuthology.orchestra.run.smithi172.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 308 kB/s | 31 kB 00:00 2024-04-25T09:25:51.453 INFO:teuthology.orchestra.run.smithi172.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 1.6 MB/s | 188 kB 00:00 2024-04-25T09:25:51.553 INFO:teuthology.orchestra.run.smithi172.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.4 MB/s | 2.0 MB 00:00 2024-04-25T09:25:51.654 INFO:teuthology.orchestra.run.smithi172.stdout:(11/11): python3-grpcio-tools-1.46.7-10.el9.x86 326 kB/s | 144 kB 00:00 2024-04-25T09:25:51.656 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:25:51.656 INFO:teuthology.orchestra.run.smithi172.stdout:Total 3.9 MB/s | 7.6 MB 00:01 2024-04-25T09:25:51.686 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:25:51.704 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:25:51.704 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:25:51.850 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:25:51.850 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:25:52.332 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:25:52.435 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-25T09:25:52.473 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-25T09:25:52.550 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-25T09:25:52.685 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-25T09:25:52.735 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-25T09:25:52.820 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-25T09:25:52.862 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-25T09:25:52.900 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:25:52.932 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 9/11 2024-04-25T09:25:54.015 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 10/11 2024-04-25T09:25:54.057 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 1/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 2/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 3/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-25T09:25:55.291 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-25T09:25:55.292 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-25T09:25:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-25T09:25:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:55.564 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:25:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T09:25:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:25:55.564 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:55.565 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:25:55.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T09:25:56.322 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:45 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:25:56.445 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-25T09:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-25T09:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 7.4 M 2024-04-25T09:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:25:56.446 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-25T09:25:56.447 INFO:teuthology.orchestra.run.smithi172.stdout:Install 12 Packages 2024-04-25T09:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 38 M 2024-04-25T09:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 209 M 2024-04-25T09:25:56.448 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:25:56.693 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:25:56.720 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 33/36 2024-04-25T09:25:56.720 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:56.721 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T09:25:56.721 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:25:56.721 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T09:25:56.721 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:56.920 INFO:teuthology.orchestra.run.smithi172.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-04-25T09:25:57.020 INFO:teuthology.orchestra.run.smithi172.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-04-25T09:25:57.045 INFO:teuthology.orchestra.run.smithi172.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-04-25T09:25:57.096 INFO:teuthology.orchestra.run.smithi172.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-04-25T09:25:57.154 INFO:teuthology.orchestra.run.smithi172.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 605 kB/s | 35 kB 00:00 2024-04-25T09:25:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:25:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 34/36 2024-04-25T09:25:57.283 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:57.283 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T09:25:57.283 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:25:57.283 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T09:25:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:57.413 INFO:teuthology.orchestra.run.smithi172.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-31 12 MB/s | 7.4 MB 00:00 2024-04-25T09:25:57.527 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:25:57.550 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 35/36 2024-04-25T09:25:57.550 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:25:57.550 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T09:25:57.550 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:25:57.550 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T09:25:57.550 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:25:57.615 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:25:57.621 INFO:teuthology.orchestra.run.smithi172.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.0 MB/s | 3.0 MB 00:00 2024-04-25T09:25:57.655 INFO:teuthology.orchestra.run.smithi172.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-04-25T09:25:57.755 INFO:teuthology.orchestra.run.smithi172.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 250 kB 00:00 2024-04-25T09:25:57.964 INFO:teuthology.orchestra.run.smithi172.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 5.9 MB/s | 4.7 MB 00:00 2024-04-25T09:25:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.1 MB/s | 5.1 MB 00:00 2024-04-25T09:25:59.298 INFO:teuthology.orchestra.run.smithi172.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-04-25T09:25:59.299 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:25:59.299 INFO:teuthology.orchestra.run.smithi172.stdout:Total 13 MB/s | 38 MB 00:02 2024-04-25T09:25:59.650 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:25:59.676 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:25:59.676 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:00.084 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:00.085 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:00.890 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:00.969 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T09:26:01.004 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:26:01.105 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:26:01.147 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T09:26:01.327 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T09:26:01.362 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T09:26:01.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T09:26:02.095 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T09:26:02.219 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T09:26:03.465 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:26:04.152 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 36/36 2024-04-25T09:26:04.152 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.0.0-3194.ga126334d.el9.x86_64 1/36 2024-04-25T09:26:04.152 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2/36 2024-04-25T09:26:04.152 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 3/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 4/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 5/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9. 6/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-25T09:26:04.153 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-25T09:26:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-25T09:26:04.155 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-25T09:26:04.155 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-25T09:26:04.155 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-25T09:26:04.155 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-25T09:26:04.155 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-25T09:26:04.155 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-25T09:26:04.518 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T09:26:04.546 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:26:05.007 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-25T09:26:05.007 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:05.007 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:05.007 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:05.007 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:05.007 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T09:26:05.008 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T09:26:05.009 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T09:26:05.010 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T09:26:05.010 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T09:26:05.010 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T09:26:05.010 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T09:26:05.010 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T09:26:05.010 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:05.010 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:05.382 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-base 2024-04-25T09:26:05.895 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:47 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:05.974 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-base-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:06.016 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:06.017 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:06.017 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:06.084 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install cephadm 2024-04-25T09:26:06.590 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:48 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:06.709 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:06.710 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:06.710 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:26:06.710 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:06.710 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 762 k 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 762 k 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 769 k 2024-04-25T09:26:06.711 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:06.983 INFO:teuthology.orchestra.run.smithi165.stdout:cephadm-19.0.0-3194.ga126334d.el9.noarch.rpm 2.7 MB/s | 762 kB 00:00 2024-04-25T09:26:06.983 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:06.984 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.7 MB/s | 762 kB 00:00 2024-04-25T09:26:06.984 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:06.989 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:06.989 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:06.995 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:06.995 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:07.063 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:07.197 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:26:07.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 1/12 2024-04-25T09:26:07.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:26:07.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:26:07.197 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T09:26:07.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T09:26:07.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T09:26:07.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T09:26:07.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T09:26:07.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T09:26:07.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:26:07.198 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T09:26:07.525 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:26:07.609 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:26:07.620 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T09:26:07.620 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:07.620 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:07.620 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:07.620 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:07.621 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:07.976 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:26:08.028 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-rook 2024-04-25T09:26:08.243 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/1 2024-04-25T09:26:08.243 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:08.243 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:08.243 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:08.243 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:08.243 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:08.478 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T09:26:08.546 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:01:57 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:08.666 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 49 k 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T09:26:08.667 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:08.668 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:08.669 INFO:teuthology.orchestra.run.smithi172.stdout:Install 13 Packages 2024-04-25T09:26:08.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:08.669 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 2.2 M 2024-04-25T09:26:08.669 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 26 M 2024-04-25T09:26:08.669 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:09.002 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:51 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:09.049 INFO:teuthology.orchestra.run.smithi172.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 243 kB/s | 26 kB 00:00 2024-04-25T09:26:09.075 INFO:teuthology.orchestra.run.smithi172.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 147 kB/s | 19 kB 00:00 2024-04-25T09:26:09.124 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:09.124 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:09.124 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3194.ga126334d.el9 ceph 157 k 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-04-25T09:26:09.125 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:09.126 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 157 k 2024-04-25T09:26:09.126 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 640 k 2024-04-25T09:26:09.126 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:09.150 INFO:teuthology.orchestra.run.smithi172.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-04-25T09:26:09.175 INFO:teuthology.orchestra.run.smithi172.stdout:(4/13): ceph-mgr-rook-19.0.0-3194.ga126334d.el9 213 kB/s | 49 kB 00:00 2024-04-25T09:26:09.200 INFO:teuthology.orchestra.run.smithi172.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-25T09:26:09.226 INFO:teuthology.orchestra.run.smithi172.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-04-25T09:26:09.293 INFO:teuthology.orchestra.run.smithi172.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 458 kB/s | 54 kB 00:00 2024-04-25T09:26:09.346 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-immutable-object-cache-19.0.0-3194.ga12633 714 kB/s | 157 kB 00:00 2024-04-25T09:26:09.347 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:09.347 INFO:teuthology.orchestra.run.smithi165.stdout:Total 708 kB/s | 157 kB 00:00 2024-04-25T09:26:09.347 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:09.357 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:09.357 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:09.413 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:09.413 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:09.468 INFO:teuthology.orchestra.run.smithi172.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 62 kB/s | 15 kB 00:00 2024-04-25T09:26:09.502 INFO:teuthology.orchestra.run.smithi172.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-04-25T09:26:09.574 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:09.664 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:26:09.689 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:26:09.689 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:26:09.689 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T09:26:09.689 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:09.727 INFO:teuthology.orchestra.run.smithi172.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 262 kB/s | 59 kB 00:00 2024-04-25T09:26:09.794 INFO:teuthology.orchestra.run.smithi172.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 410 kB/s | 206 kB 00:00 2024-04-25T09:26:09.902 INFO:teuthology.orchestra.run.smithi172.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 513 kB/s | 90 kB 00:00 2024-04-25T09:26:10.028 INFO:teuthology.orchestra.run.smithi172.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2024-04-25T09:26:10.028 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:10.028 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-04-25T09:26:10.091 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:10.105 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:10.105 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:10.188 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:10.189 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:10.550 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3194.ga126334d. 1/1 2024-04-25T09:26:10.551 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:10.551 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:10.551 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:10.551 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:10.551 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:10.699 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:10.766 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr 2024-04-25T09:26:10.873 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T09:26:10.928 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T09:26:10.992 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T09:26:11.030 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T09:26:11.071 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T09:26:11.165 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T09:26:11.274 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T09:26:11.283 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:53 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:11.331 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T09:26:11.364 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-mgr-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:11.406 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:11.407 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:11.407 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:11.490 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T09:26:12.004 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:54 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:12.048 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T09:26:12.103 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T09:26:12.126 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:12.127 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:12.127 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:26:12.127 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:12.127 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:12.127 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 3.5 M 2024-04-25T09:26:12.127 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 34 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 16 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:12.128 INFO:teuthology.orchestra.run.smithi165.stdout:Install 11 Packages 2024-04-25T09:26:12.129 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:12.129 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 7.6 M 2024-04-25T09:26:12.129 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 100 M 2024-04-25T09:26:12.129 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:12.137 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T09:26:12.185 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T09:26:12.207 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:26:12.733 INFO:teuthology.orchestra.run.smithi165.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3194.ga1 179 kB/s | 34 kB 00:00 2024-04-25T09:26:12.758 INFO:teuthology.orchestra.run.smithi165.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3194.ga12 76 kB/s | 16 kB 00:00 2024-04-25T09:26:12.900 INFO:teuthology.orchestra.run.smithi165.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-04-25T09:26:12.978 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:26:12.978 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 1/13 2024-04-25T09:26:12.978 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T09:26:12.978 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T09:26:12.978 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T09:26:12.978 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T09:26:12.978 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T09:26:12.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T09:26:12.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T09:26:12.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T09:26:12.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T09:26:12.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T09:26:12.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T09:26:13.050 INFO:teuthology.orchestra.run.smithi165.stdout:(4/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.9 MB/s | 863 kB 00:00 2024-04-25T09:26:13.108 INFO:teuthology.orchestra.run.smithi165.stdout:(5/11): ceph-mgr-dashboard-19.0.0-3194.ga126334 6.2 MB/s | 3.5 MB 00:00 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T09:26:13.295 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:13.296 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:13.442 INFO:teuthology.orchestra.run.smithi165.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 50 kB/s | 19 kB 00:00 2024-04-25T09:26:13.562 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T09:26:13.651 INFO:teuthology.orchestra.run.smithi165.stdout:(7/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 730 kB/s | 548 kB 00:00 2024-04-25T09:26:13.759 INFO:teuthology.orchestra.run.smithi165.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 456 kB/s | 144 kB 00:00 2024-04-25T09:26:13.793 INFO:teuthology.orchestra.run.smithi165.stdout:(9/11): python3-repoze-lru-0.7-16.el9.noarch.rp 217 kB/s | 31 kB 00:00 2024-04-25T09:26:13.954 INFO:teuthology.orchestra.run.smithi165.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 983 kB/s | 188 kB 00:00 2024-04-25T09:26:14.081 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:03 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:14.085 INFO:teuthology.orchestra.run.smithi165.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.1 MB/s | 2.0 MB 00:00 2024-04-25T09:26:14.089 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:14.089 INFO:teuthology.orchestra.run.smithi165.stdout:Total 3.9 MB/s | 7.6 MB 00:01 2024-04-25T09:26:14.118 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:14.135 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:14.135 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:26:14.201 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 142 k 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout:Install 6 Packages 2024-04-25T09:26:14.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 7.0 M 2024-04-25T09:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 33 M 2024-04-25T09:26:14.203 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:14.282 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:14.283 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:14.689 INFO:teuthology.orchestra.run.smithi172.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-04-25T09:26:14.772 INFO:teuthology.orchestra.run.smithi172.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3194.ga126334d.e 564 kB/s | 142 kB 00:00 2024-04-25T09:26:14.776 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:14.858 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-25T09:26:14.896 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-25T09:26:14.897 INFO:teuthology.orchestra.run.smithi172.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-25T09:26:14.973 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-25T09:26:15.099 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-25T09:26:15.158 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-25T09:26:15.242 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-25T09:26:15.293 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-25T09:26:15.321 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:26:15.353 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 9/11 2024-04-25T09:26:15.372 INFO:teuthology.orchestra.run.smithi172.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 100 kB/s | 58 kB 00:00 2024-04-25T09:26:15.456 INFO:teuthology.orchestra.run.smithi172.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 95 kB/s | 51 kB 00:00 2024-04-25T09:26:15.890 INFO:teuthology.orchestra.run.smithi172.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 456 kB/s | 548 kB 00:01 2024-04-25T09:26:15.894 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:15.894 INFO:teuthology.orchestra.run.smithi172.stdout:Total 4.1 MB/s | 7.0 MB 00:01 2024-04-25T09:26:15.965 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:15.978 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:15.978 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:16.074 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:16.075 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:16.381 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:16.403 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 10/11 2024-04-25T09:26:16.438 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:26:16.548 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T09:26:16.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T09:26:17.155 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T09:26:17.254 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T09:26:17.316 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T09:26:17.354 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 11/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el 1/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noa 2/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9 3/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-25T09:26:17.499 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-25T09:26:17.800 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T09:26:17.801 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T09:26:17.802 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T09:26:17.802 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T09:26:17.802 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:17.802 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:18.049 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T09:26:18.151 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/6 2024-04-25T09:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T09:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T09:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T09:26:18.152 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T09:26:18.403 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:18.404 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:18.572 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:00 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:18.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-fuse 2024-04-25T09:26:18.695 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 7.4 M 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T09:26:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-04-25T09:26:18.697 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:18.698 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 38 M 2024-04-25T09:26:18.698 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 209 M 2024-04-25T09:26:18.698 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:19.182 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:08 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:19.304 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 870 k 2024-04-25T09:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:26:19.305 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout:Install 2 Packages 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 950 k 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 4.0 M 2024-04-25T09:26:19.306 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:19.442 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 605 kB/s | 195 kB 00:00 2024-04-25T09:26:19.500 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-04-25T09:26:19.650 INFO:teuthology.orchestra.run.smithi172.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 481 kB/s | 80 kB 00:00 2024-04-25T09:26:19.683 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-04-25T09:26:19.742 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-04-25T09:26:19.801 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 35 kB 00:00 2024-04-25T09:26:19.975 INFO:teuthology.orchestra.run.smithi172.stdout:(2/2): ceph-fuse-19.0.0-3194.ga126334d.el9.x86_ 1.7 MB/s | 870 kB 00:00 2024-04-25T09:26:19.976 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:19.976 INFO:teuthology.orchestra.run.smithi172.stdout:Total 1.4 MB/s | 950 kB 00:00 2024-04-25T09:26:19.987 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:20.012 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:20.012 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:20.090 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:20.090 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:20.275 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:20.417 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-31 5.7 MB/s | 7.4 MB 00:01 2024-04-25T09:26:20.427 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T09:26:20.476 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.1 MB/s | 3.0 MB 00:00 2024-04-25T09:26:20.498 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:26:20.676 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 944 kB/s | 244 kB 00:00 2024-04-25T09:26:20.793 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-04-25T09:26:20.852 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.5 MB/s | 4.7 MB 00:01 2024-04-25T09:26:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:26:21.138 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/2 2024-04-25T09:26:21.310 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.1 MB/s | 5.1 MB 00:00 2024-04-25T09:26:21.393 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T09:26:21.393 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:21.393 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:21.393 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T09:26:21.393 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:21.393 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:21.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-volume 2024-04-25T09:26:22.184 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:11 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:22.307 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:22.307 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:22.307 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 273 k 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout:Install 2 Packages 2024-04-25T09:26:22.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:22.309 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 350 k 2024-04-25T09:26:22.309 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 1.5 M 2024-04-25T09:26:22.309 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:22.652 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.7 MB/s | 16 MB 00:01 2024-04-25T09:26:22.653 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:22.653 INFO:teuthology.orchestra.run.smithi165.stdout:Total 9.6 MB/s | 38 MB 00:03 2024-04-25T09:26:22.739 INFO:teuthology.orchestra.run.smithi172.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 563 kB/s | 77 kB 00:00 2024-04-25T09:26:22.923 INFO:teuthology.orchestra.run.smithi172.stdout:(2/2): ceph-volume-19.0.0-3194.ga126334d.el9.no 851 kB/s | 273 kB 00:00 2024-04-25T09:26:22.923 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:22.924 INFO:teuthology.orchestra.run.smithi172.stdout:Total 569 kB/s | 350 kB 00:00 2024-04-25T09:26:22.935 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:22.944 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:22.944 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:22.971 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:22.971 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:23.004 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:23.030 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:23.030 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:23.110 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:23.299 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-25T09:26:23.333 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:26:23.349 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:26:23.349 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:26:23.349 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T09:26:23.349 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:23.440 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:23.440 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:24.014 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 1/2 2024-04-25T09:26:24.256 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:24.310 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-25T09:26:24.310 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:24.310 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:24.310 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:24.310 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T09:26:24.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:24.311 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:24.331 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T09:26:24.367 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:26:24.467 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:26:24.509 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T09:26:24.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados-devel 2024-04-25T09:26:24.686 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T09:26:24.725 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T09:26:24.801 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T09:26:25.127 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:14 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:25.253 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:25.254 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:25.255 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-04-25T09:26:25.255 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:25.255 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:25.255 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 125 k 2024-04-25T09:26:25.255 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:25.256 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:25.256 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:25.256 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-25T09:26:25.256 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:25.256 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 125 k 2024-04-25T09:26:25.256 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 445 k 2024-04-25T09:26:25.256 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:25.448 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T09:26:25.470 INFO:teuthology.orchestra.run.smithi172.stdout:librados-devel-19.0.0-3194.ga126334d.el9.x86_64 581 kB/s | 125 kB 00:00 2024-04-25T09:26:25.471 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:25.471 INFO:teuthology.orchestra.run.smithi172.stdout:Total 577 kB/s | 125 kB 00:00 2024-04-25T09:26:25.471 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:25.476 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:25.476 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:25.544 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:25.544 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:25.583 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T09:26:25.695 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:25.808 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:26.241 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:26.484 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:26.484 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:26.484 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:26.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs2 2024-04-25T09:26:26.810 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:26:27.241 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:16 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:27.321 INFO:teuthology.orchestra.run.smithi172.stdout:Package libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:27.363 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:27.364 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:26:27.364 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:27.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install libcephfs-devel 2024-04-25T09:26:27.851 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T09:26:27.881 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:26:27.957 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:16 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:28.079 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:28.080 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:28.080 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-04-25T09:26:28.080 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:28.080 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:28.080 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 32 k 2024-04-25T09:26:28.080 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:28.081 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:28.081 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:28.081 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-25T09:26:28.081 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:28.081 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 32 k 2024-04-25T09:26:28.081 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 142 k 2024-04-25T09:26:28.081 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:28.309 INFO:teuthology.orchestra.run.smithi172.stdout:libcephfs-devel-19.0.0-3194.ga126334d.el9.x86_6 140 kB/s | 32 kB 00:00 2024-04-25T09:26:28.309 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:28.309 INFO:teuthology.orchestra.run.smithi172.stdout:Total 139 kB/s | 32 kB 00:00 2024-04-25T09:26:28.309 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:28.312 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:28.312 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:28.314 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:28.315 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:28.389 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:28.494 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:28.836 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:29.040 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:29.040 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:29.040 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:29.040 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:29.040 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:29.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librados2 2024-04-25T09:26:29.726 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:18 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:29.805 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:29.846 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:29.847 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:26:29.847 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:29.915 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install librbd1 2024-04-25T09:26:30.419 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 12/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3194.ga1263 1/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T09:26:30.420 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T09:26:30.427 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:19 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:30.506 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:30.547 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:30.548 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:26:30.548 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:30.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rados 2024-04-25T09:26:30.764 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T09:26:30.764 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T09:26:30.765 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:31.126 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:20 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:31.157 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-rook 2024-04-25T09:26:31.204 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:31.246 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:31.247 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:26:31.247 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:31.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rgw 2024-04-25T09:26:31.676 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:13 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:31.796 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:31.797 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:31.797 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:26:31.798 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:31.798 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:31.798 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 49 k 2024-04-25T09:26:31.798 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:26:31.798 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T09:26:31.798 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T09:26:31.799 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T09:26:31.799 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T09:26:31.799 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T09:26:31.799 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T09:26:31.799 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T09:26:31.799 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T09:26:31.799 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T09:26:31.800 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T09:26:31.800 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T09:26:31.800 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T09:26:31.800 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:31.800 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:31.800 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:31.801 INFO:teuthology.orchestra.run.smithi165.stdout:Install 13 Packages 2024-04-25T09:26:31.801 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:31.801 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 2.2 M 2024-04-25T09:26:31.802 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 26 M 2024-04-25T09:26:31.802 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:31.833 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:20 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:31.913 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:31.954 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:26:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:32.028 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-cephfs 2024-04-25T09:26:32.149 INFO:teuthology.orchestra.run.smithi165.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 193 kB/s | 26 kB 00:00 2024-04-25T09:26:32.182 INFO:teuthology.orchestra.run.smithi165.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 115 kB/s | 19 kB 00:00 2024-04-25T09:26:32.207 INFO:teuthology.orchestra.run.smithi165.stdout:(3/13): ceph-mgr-rook-19.0.0-3194.ga126334d.el9 257 kB/s | 49 kB 00:00 2024-04-25T09:26:32.274 INFO:teuthology.orchestra.run.smithi165.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-04-25T09:26:32.316 INFO:teuthology.orchestra.run.smithi165.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-25T09:26:32.341 INFO:teuthology.orchestra.run.smithi165.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 803 kB/s | 54 kB 00:00 2024-04-25T09:26:32.459 INFO:teuthology.orchestra.run.smithi165.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-04-25T09:26:32.549 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:21 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:32.592 INFO:teuthology.orchestra.run.smithi165.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 117 kB/s | 32 kB 00:00 2024-04-25T09:26:32.617 INFO:teuthology.orchestra.run.smithi165.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 54 kB/s | 15 kB 00:00 2024-04-25T09:26:32.628 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:32.669 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:32.670 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:26:32.670 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:32.736 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install python3-rbd 2024-04-25T09:26:32.767 INFO:teuthology.orchestra.run.smithi165.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 394 kB/s | 59 kB 00:00 2024-04-25T09:26:32.851 INFO:teuthology.orchestra.run.smithi165.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 525 kB/s | 206 kB 00:00 2024-04-25T09:26:32.893 INFO:teuthology.orchestra.run.smithi165.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.4 MB/s | 1.0 MB 00:00 2024-04-25T09:26:32.918 INFO:teuthology.orchestra.run.smithi165.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 596 kB/s | 90 kB 00:00 2024-04-25T09:26:32.921 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:32.921 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-04-25T09:26:32.983 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:32.997 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:32.997 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:33.081 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:33.082 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:33.254 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:22 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:33.334 INFO:teuthology.orchestra.run.smithi172.stdout:Package python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:33.376 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:33.377 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-25T09:26:33.377 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:33.441 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-fuse 2024-04-25T09:26:33.580 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:33.733 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T09:26:33.794 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T09:26:33.857 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T09:26:33.895 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T09:26:33.936 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T09:26:33.959 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:22 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:34.029 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T09:26:34.078 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:34.078 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:34.078 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-25T09:26:34.078 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 90 k 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:34.079 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 90 k 2024-04-25T09:26:34.080 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 313 k 2024-04-25T09:26:34.080 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:34.139 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T09:26:34.196 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T09:26:34.286 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-fuse-19.0.0-3194.ga126334d.el9.x86_64.rpm 437 kB/s | 90 kB 00:00 2024-04-25T09:26:34.286 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:34.286 INFO:teuthology.orchestra.run.smithi172.stdout:Total 434 kB/s | 90 kB 00:00 2024-04-25T09:26:34.286 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:34.295 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:34.295 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:34.357 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:34.358 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:34.510 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:34.615 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:34.908 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T09:26:34.960 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T09:26:34.991 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:34.993 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T09:26:35.041 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T09:26:35.063 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:26:35.239 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:35.239 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:35.239 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:35.239 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:35.239 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:35.239 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:35.477 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-mirror 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 13/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 1/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T09:26:35.806 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T09:26:35.807 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T09:26:35.807 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T09:26:35.807 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T09:26:36.004 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:25 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T09:26:36.104 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:36.105 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:36.127 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:36.127 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:36.127 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repo Size 2024-04-25T09:26:36.127 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:36.127 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:36.128 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:26:36.128 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:36.128 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:36.128 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:36.128 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-25T09:26:36.128 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:36.128 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 3.4 M 2024-04-25T09:26:36.129 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 29 M 2024-04-25T09:26:36.129 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:36.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T09:26:36.556 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-mirror-19.0.0-3194.ga126334d.el9.x86_64.rpm 8.0 MB/s | 3.4 MB 00:00 2024-04-25T09:26:36.557 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:36.557 INFO:teuthology.orchestra.run.smithi172.stdout:Total 7.9 MB/s | 3.4 MB 00:00 2024-04-25T09:26:36.558 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:36.568 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:36.569 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:36.651 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:36.651 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:36.842 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:18 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:36.962 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:36.964 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:36.964 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:26:36.964 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:36.964 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:36.964 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 142 k 2024-04-25T09:26:36.964 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:26:36.964 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout:Install 6 Packages 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 7.0 M 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 33 M 2024-04-25T09:26:36.965 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:37.224 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:37.282 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:37.306 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:37.307 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:26:37.307 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T09:26:37.307 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:26:37.307 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:26:37.307 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:37.619 INFO:teuthology.orchestra.run.smithi165.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3194.ga126334d.e 643 kB/s | 142 kB 00:00 2024-04-25T09:26:37.644 INFO:teuthology.orchestra.run.smithi165.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-04-25T09:26:37.753 INFO:teuthology.orchestra.run.smithi165.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 532 kB/s | 58 kB 00:00 2024-04-25T09:26:37.795 INFO:teuthology.orchestra.run.smithi165.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.1 MB/s | 548 kB 00:00 2024-04-25T09:26:37.820 INFO:teuthology.orchestra.run.smithi165.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 765 kB/s | 51 kB 00:00 2024-04-25T09:26:38.070 INFO:teuthology.orchestra.run.smithi165.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.9 MB/s | 6.0 MB 00:00 2024-04-25T09:26:38.071 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:38.071 INFO:teuthology.orchestra.run.smithi165.stdout:Total 6.3 MB/s | 7.0 MB 00:01 2024-04-25T09:26:38.141 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:38.151 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:38.152 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:38.248 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:38.248 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:38.465 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:38.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:38.465 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:38.465 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:38.465 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:38.465 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:38.559 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:38.697 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install rbd-nbd 2024-04-25T09:26:38.736 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T09:26:38.788 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T09:26:39.232 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:02:28 ago on Thu 25 Apr 2024 09:24:11 AM UTC. 2024-04-25T09:26:39.317 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T09:26:39.357 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 175 k 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout:Install 1 Package 2024-04-25T09:26:39.358 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:39.359 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 175 k 2024-04-25T09:26:39.359 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 673 k 2024-04-25T09:26:39.359 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-25T09:26:39.408 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T09:26:39.471 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T09:26:39.500 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:26:39.677 INFO:teuthology.orchestra.run.smithi172.stdout:rbd-nbd-19.0.0-3194.ga126334d.el9.x86_64.rpm 551 kB/s | 175 kB 00:00 2024-04-25T09:26:39.677 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:39.678 INFO:teuthology.orchestra.run.smithi172.stdout:Total 548 kB/s | 175 kB 00:00 2024-04-25T09:26:39.678 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-25T09:26:39.687 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-25T09:26:39.688 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-25T09:26:39.751 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-25T09:26:39.751 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-25T09:26:39.913 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-25T09:26:40.015 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:40.197 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 6/6 2024-04-25T09:26:40.197 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 1/6 2024-04-25T09:26:40.197 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T09:26:40.197 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T09:26:40.197 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T09:26:40.197 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T09:26:40.411 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T09:26:40.453 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T09:26:40.454 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:40.454 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:40.656 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:40.656 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:40.656 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-25T09:26:40.656 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:40.656 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:26:40.656 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-25T09:26:40.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-fuse 2024-04-25T09:26:40.867 DEBUG:teuthology.parallel:result is None 2024-04-25T09:26:41.196 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:23 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:41.318 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 870 k 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:41.319 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:41.320 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:41.320 INFO:teuthology.orchestra.run.smithi165.stdout:Install 2 Packages 2024-04-25T09:26:41.320 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:41.320 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 950 k 2024-04-25T09:26:41.320 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 4.0 M 2024-04-25T09:26:41.320 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:41.800 INFO:teuthology.orchestra.run.smithi165.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 372 kB/s | 80 kB 00:00 2024-04-25T09:26:41.996 INFO:teuthology.orchestra.run.smithi165.stdout:(2/2): ceph-fuse-19.0.0-3194.ga126334d.el9.x86_ 2.1 MB/s | 870 kB 00:00 2024-04-25T09:26:41.997 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:41.997 INFO:teuthology.orchestra.run.smithi165.stdout:Total 1.4 MB/s | 950 kB 00:00 2024-04-25T09:26:42.008 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:42.033 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:42.033 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:42.112 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:42.112 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:42.296 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:42.440 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T09:26:42.510 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:26:43.179 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2/2 2024-04-25T09:26:43.179 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/2 2024-04-25T09:26:43.428 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T09:26:43.428 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:43.428 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:43.429 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T09:26:43.429 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:43.429 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:43.654 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-volume 2024-04-25T09:26:44.179 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:26 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:44.301 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:19.0.0-3194.ga126334d.el9 ceph-noarch 273 k 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:44.302 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:44.303 INFO:teuthology.orchestra.run.smithi165.stdout:Install 2 Packages 2024-04-25T09:26:44.303 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:44.303 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 350 k 2024-04-25T09:26:44.303 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 1.5 M 2024-04-25T09:26:44.303 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:44.659 INFO:teuthology.orchestra.run.smithi165.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 1.0 MB/s | 77 kB 00:00 2024-04-25T09:26:44.834 INFO:teuthology.orchestra.run.smithi165.stdout:(2/2): ceph-volume-19.0.0-3194.ga126334d.el9.no 1.1 MB/s | 273 kB 00:00 2024-04-25T09:26:44.835 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:44.835 INFO:teuthology.orchestra.run.smithi165.stdout:Total 658 kB/s | 350 kB 00:00 2024-04-25T09:26:44.846 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:44.856 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:44.856 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:44.883 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:44.884 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:45.032 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:45.208 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-25T09:26:45.245 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:26:45.260 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2/2 2024-04-25T09:26:45.260 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:26:45.260 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T09:26:45.261 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:45.946 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 1/2 2024-04-25T09:26:46.228 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-25T09:26:46.228 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:46.228 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:46.228 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:19.0.0-3194.ga126334d.el9.noarch 2024-04-25T09:26:46.228 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T09:26:46.228 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:46.228 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:46.538 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados-devel 2024-04-25T09:26:47.060 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:29 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:47.184 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:47.185 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:47.185 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-04-25T09:26:47.185 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 125 k 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 125 k 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 445 k 2024-04-25T09:26:47.186 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:47.565 INFO:teuthology.orchestra.run.smithi165.stdout:librados-devel-19.0.0-3194.ga126334d.el9.x86_64 330 kB/s | 125 kB 00:00 2024-04-25T09:26:47.565 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:47.566 INFO:teuthology.orchestra.run.smithi165.stdout:Total 329 kB/s | 125 kB 00:00 2024-04-25T09:26:47.566 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:47.572 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:47.572 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:47.643 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:47.643 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:47.795 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:47.894 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:48.340 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:48.579 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:48.579 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:48.579 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:48.579 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:48.579 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:48.579 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:48.792 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs2 2024-04-25T09:26:49.316 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:31 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:49.396 INFO:teuthology.orchestra.run.smithi165.stdout:Package libcephfs2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:49.438 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:49.438 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:49.439 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:49.516 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs-devel 2024-04-25T09:26:50.039 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:32 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:50.160 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:50.161 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-04-25T09:26:50.161 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:50.161 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:50.161 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.0.0-3194.ga126334d.el9 ceph 32 k 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 32 k 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 142 k 2024-04-25T09:26:50.162 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:50.326 INFO:teuthology.orchestra.run.smithi165.stdout:libcephfs-devel-19.0.0-3194.ga126334d.el9.x86_6 194 kB/s | 32 kB 00:00 2024-04-25T09:26:50.326 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:50.326 INFO:teuthology.orchestra.run.smithi165.stdout:Total 192 kB/s | 32 kB 00:00 2024-04-25T09:26:50.327 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:50.330 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:50.331 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:50.332 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:50.333 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:50.418 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:50.529 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:50.874 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:51.083 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:51.083 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:51.083 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:51.083 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:51.083 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:51.083 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:51.249 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados2 2024-04-25T09:26:51.758 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:33 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:51.838 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:51.878 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:51.879 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:51.880 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:51.955 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librbd1 2024-04-25T09:26:52.472 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:34 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:52.551 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:52.592 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:52.593 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:52.593 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:52.665 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rados 2024-04-25T09:26:53.177 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:35 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:53.255 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rados-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:53.296 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:53.297 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:53.297 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:53.362 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rgw 2024-04-25T09:26:53.882 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:35 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:53.962 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rgw-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:54.004 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:54.005 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:54.005 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:54.074 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-cephfs 2024-04-25T09:26:54.597 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:36 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:54.676 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-cephfs-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:54.717 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:54.718 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:54.718 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:54.792 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rbd 2024-04-25T09:26:55.310 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:37 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:55.390 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rbd-2:19.0.0-3194.ga126334d.el9.x86_64 is already installed. 2024-04-25T09:26:55.431 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:55.432 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-04-25T09:26:55.432 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:55.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-fuse 2024-04-25T09:26:56.014 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:38 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:56.135 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:56.135 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.0.0-3194.ga126334d.el9 ceph 90 k 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 90 k 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 313 k 2024-04-25T09:26:56.136 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:56.637 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-fuse-19.0.0-3194.ga126334d.el9.x86_64.rpm 180 kB/s | 90 kB 00:00 2024-04-25T09:26:56.638 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:56.638 INFO:teuthology.orchestra.run.smithi165.stdout:Total 179 kB/s | 90 kB 00:00 2024-04-25T09:26:56.638 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:56.647 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:56.647 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:56.709 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:56.709 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:56.856 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:56.966 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:57.331 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:57.576 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:57.576 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:57.576 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:26:57.577 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:26:57.577 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:57.577 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:26:57.805 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-mirror 2024-04-25T09:26:58.338 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:40 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:26:58.482 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:26:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:58.483 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-04-25T09:26:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:58.483 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.0.0-3194.ga126334d.el9 ceph 3.4 M 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 3.4 M 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 29 M 2024-04-25T09:26:58.484 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:26:59.090 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-mirror-19.0.0-3194.ga126334d.el9.x86_64.rpm 5.6 MB/s | 3.4 MB 00:00 2024-04-25T09:26:59.091 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:26:59.091 INFO:teuthology.orchestra.run.smithi165.stdout:Total 5.6 MB/s | 3.4 MB 00:00 2024-04-25T09:26:59.091 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:26:59.102 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:26:59.102 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:26:59.185 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:26:59.185 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:26:59.753 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:26:59.816 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:59.841 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:26:59.841 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T09:26:59.841 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T09:26:59.841 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:26:59.841 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T09:26:59.841 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:01.033 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:27:01.033 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:01.033 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:27:01.033 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:27:01.033 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:01.033 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:27:01.242 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-nbd 2024-04-25T09:27:01.762 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:43 ago on Thu 25 Apr 2024 09:24:18 AM UTC. 2024-04-25T09:27:01.887 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.0.0-3194.ga126334d.el9 ceph 175 k 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-04-25T09:27:01.888 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-04-25T09:27:01.889 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:01.889 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 175 k 2024-04-25T09:27:01.889 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 673 k 2024-04-25T09:27:01.889 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-04-25T09:27:02.151 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-nbd-19.0.0-3194.ga126334d.el9.x86_64.rpm 670 kB/s | 175 kB 00:00 2024-04-25T09:27:02.151 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-04-25T09:27:02.152 INFO:teuthology.orchestra.run.smithi165.stdout:Total 666 kB/s | 175 kB 00:00 2024-04-25T09:27:02.152 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-04-25T09:27:02.161 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-04-25T09:27:02.161 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-04-25T09:27:02.225 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-04-25T09:27:02.225 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-04-25T09:27:02.376 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-04-25T09:27:02.489 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:27:02.876 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:27:03.116 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 1/1 2024-04-25T09:27:03.116 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:03.116 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-04-25T09:27:03.116 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.0.0-3194.ga126334d.el9.x86_64 2024-04-25T09:27:03.116 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:03.116 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-04-25T09:27:03.372 DEBUG:teuthology.parallel:result is None 2024-04-25T09:27:03.373 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:27:03.517 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T09:27:03.538 INFO:teuthology.orchestra.run.smithi165.stdout:19.0.0-3194.ga126334d.el9 2024-04-25T09:27:03.539 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3194.ga126334d.el9 2024-04-25T09:27:03.539 INFO:teuthology.task.install:The correct ceph version 19.0.0-3194.ga126334d is installed. 2024-04-25T09:27:03.541 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a126334d8733673d119ffdf40d6ae4b541a0a1cd 2024-04-25T09:27:03.675 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T09:27:03.699 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-3194.ga126334d.el9 2024-04-25T09:27:03.700 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3194.ga126334d.el9 2024-04-25T09:27:03.700 INFO:teuthology.task.install:The correct ceph version 19.0.0-3194.ga126334d is installed. 2024-04-25T09:27:03.701 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T09:27:03.702 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:03.702 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:27:03.727 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:03.727 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:27:03.768 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T09:27:03.769 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:03.769 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:27:03.792 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:27:03.856 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:03.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:27:03.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:27:03.948 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T09:27:03.949 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:03.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:27:03.972 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:27:04.035 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:04.035 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:27:04.061 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:27:04.128 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T09:27:04.128 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:04.128 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:27:04.152 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:27:04.215 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:04.215 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:27:04.238 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:27:04.302 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T09:27:04.399 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T09:27:04.399 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2024-04-25T09:27:04.401 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-04-25T09:27:04.425 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T09:27:04.425 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:27:04.466 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:27:04.489 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T09:27:04.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:27:04.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:27:04.565 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T09:27:04.566 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T09:27:04.566 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981', 'branch': 'wip-matanb-crimson-testing-april-22', 'description': 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency}', 'email': None, 'first_in_suite': False, 'job_id': '7672981', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-april-22'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '472cc2b524a88306ef4535053d26658c5fd6e9db'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1211, 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_472cc2b524a88306ef4535053d26658c5fd6e9db/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '472cc2b524a88306ef4535053d26658c5fd6e9db', 'targets': {'smithi165.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFGhkootENZ71WBWAF+F1z6s4sAto/rU2ncEOqHA+2Ueljbpu7wTYVHkpPZbZNa7OBGMA9fkq6y1jWDVq2Uhqk8=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLwxBZG9FMZXPK36TWfeJjEm+7P24bDJnjPfMf8NQwUBmcyzFz800eK5ZVNQxLlQwesLC07WQQRs015McaGbn/Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:07:11', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T09:27:04.567 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:27:04.596 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:27:04.611 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:27:04.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:27:04.675 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:04.675 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:27:04.727 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:27:04.727 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 09:27:00.107573158 +0000 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 09:23:31.477560380 +0000 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 09:23:31.477560380 +0000 2024-04-25T09:27:04.782 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-04-25 09:23:31.477560380 +0000 2024-04-25T09:27:04.783 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:27:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T09:27:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T09:27:04.844 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000207435 s, 2.5 MB/s 2024-04-25T09:27:04.845 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:27:04.900 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 09:27:00.107573158 +0000 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 09:23:31.824554071 +0000 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 09:23:31.824554071 +0000 2024-04-25T09:27:04.955 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-04-25 09:23:31.824554071 +0000 2024-04-25T09:27:04.956 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:27:05.017 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T09:27:05.017 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T09:27:05.017 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000206016 s, 2.5 MB/s 2024-04-25T09:27:05.018 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:27:05.073 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-04-25T09:27:05.127 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:27:05.127 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:05.128 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T09:27:05.128 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:05.128 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:05.128 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 09:27:00.108573142 +0000 2024-04-25T09:27:05.128 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 09:23:32.173547726 +0000 2024-04-25T09:27:05.128 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 09:23:32.173547726 +0000 2024-04-25T09:27:05.128 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-04-25 09:23:32.173547726 +0000 2024-04-25T09:27:05.128 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:27:05.190 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T09:27:05.190 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T09:27:05.190 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000213664 s, 2.4 MB/s 2024-04-25T09:27:05.191 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:27:05.247 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-04-25T09:27:05.301 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:27:05.301 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:05.301 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T09:27:05.302 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:05.302 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:05.302 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-04-25 09:27:00.108573142 +0000 2024-04-25T09:27:05.302 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-04-25 09:23:32.665538781 +0000 2024-04-25T09:27:05.302 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-04-25 09:23:32.665538781 +0000 2024-04-25T09:27:05.302 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-04-25 09:23:32.665538781 +0000 2024-04-25T09:27:05.302 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:27:05.366 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-04-25T09:27:05.366 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-04-25T09:27:05.366 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000187228 s, 2.7 MB/s 2024-04-25T09:27:05.368 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:27:05.423 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-25T09:27:05.424 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:05.424 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:27:05.440 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:27:05.440 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 09:26:37.570429854 +0000 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 09:23:31.496503437 +0000 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 09:23:31.496503437 +0000 2024-04-25T09:27:05.495 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 09:23:31.496503437 +0000 2024-04-25T09:27:05.495 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:27:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T09:27:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T09:27:05.557 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000259534 s, 2.0 MB/s 2024-04-25T09:27:05.558 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:27:05.614 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 09:26:37.570429854 +0000 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 09:23:31.829494759 +0000 2024-04-25T09:27:05.670 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 09:23:31.829494759 +0000 2024-04-25T09:27:05.671 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 09:23:31.829494759 +0000 2024-04-25T09:27:05.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:27:05.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T09:27:05.732 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T09:27:05.732 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000255875 s, 2.0 MB/s 2024-04-25T09:27:05.733 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:27:05.789 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-04-25T09:27:05.843 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:27:05.843 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:05.843 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T09:27:05.843 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:05.843 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:05.844 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 09:26:37.571429829 +0000 2024-04-25T09:27:05.844 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 09:23:32.174485768 +0000 2024-04-25T09:27:05.844 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 09:23:32.174485768 +0000 2024-04-25T09:27:05.844 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 09:23:32.174485768 +0000 2024-04-25T09:27:05.844 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:27:05.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T09:27:05.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T09:27:05.905 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000175358 s, 2.9 MB/s 2024-04-25T09:27:05.906 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:27:05.962 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-25 09:26:37.571429829 +0000 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-25 09:23:32.519476778 +0000 2024-04-25T09:27:06.017 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-25 09:23:32.519476778 +0000 2024-04-25T09:27:06.018 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-25 09:23:32.519476778 +0000 2024-04-25T09:27:06.018 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:27:06.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-25T09:27:06.079 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-25T09:27:06.079 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000221864 s, 2.3 MB/s 2024-04-25T09:27:06.080 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:27:06.136 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-25T09:27:06.136 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-25T09:27:06.137 INFO:tasks.ceph:Generating config... 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-04-25T09:27:06.138 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] err to stderr = True 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] log flush on exit = True 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] log to file = False 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] log to stderr = True 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T09:27:06.139 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-25T09:27:06.140 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-04-25T09:27:06.140 INFO:tasks.ceph:[client.0] debug ms = 1 2024-04-25T09:27:06.140 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-04-25T09:27:06.141 INFO:tasks.ceph:[client.0] debug rados = 20 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] ms client mode = crc 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] ms service mode = crc 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-04-25T09:27:06.141 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-04-25T09:27:06.141 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T09:27:06.141 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T09:27:06.141 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-04-25T09:27:06.142 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-04-25T09:27:06.142 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-04-25T09:27:06.142 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-04-25T09:27:06.142 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-04-25T09:27:06.143 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-04-25T09:27:06.143 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T09:27:06.143 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T09:27:06.216 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T09:27:06.220 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T09:27:06.274 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:27:06.299 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.165')] 2024-04-25T09:27:06.299 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.165', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-04-25T09:27:06.300 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:06.300 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:27:06.354 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.165 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:06.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:06.458+0000 7f1f318b5f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:06.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:06.458+0000 7f1f318b5f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:06.444 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:06.459+0000 7f1f318b5f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:monmaptool: generated fsid cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:setting min_mon_release = quincy 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:epoch 0 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:fsid cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:last_changed 2024-04-25T09:27:06.460366+0000 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:created 2024-04-25T09:27:06.460366+0000 2024-04-25T09:27:06.445 INFO:teuthology.orchestra.run.smithi165.stdout:min_mon_release 17 (quincy) 2024-04-25T09:27:06.446 INFO:teuthology.orchestra.run.smithi165.stdout:election_strategy: 1 2024-04-25T09:27:06.446 INFO:teuthology.orchestra.run.smithi165.stdout:0: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.a 2024-04-25T09:27:06.446 INFO:teuthology.orchestra.run.smithi165.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-25T09:27:06.447 DEBUG:teuthology.orchestra.run.smithi165:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:27:06.461 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2... 2024-04-25T09:27:06.462 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:27:06.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.541 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.542 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:27:06.543 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-04-25T09:27:06.544 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = 172.21.15.165 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: ms client mode = crc 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: ms cluster mode = crc 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: ms mon client mode = crc 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: ms mon cluster mode = crc 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: ms mon service mode = crc 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: ms service mode = crc 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_min_size = 2 2024-04-25T09:27:06.545 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_size = 3 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 120 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-04-25T09:27:06.546 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:27:06.547 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: debug monc = 20 2024-04-25T09:27:06.548 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore compression algorithm = snappy 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore compression mode = aggressive 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore rocksdb cf = False 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: crimson alien thread cpu cores = 6-7 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: crimson osd obc lru size = 10 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 20 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 20 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 10 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: err to stderr = True 2024-04-25T09:27:06.549 INFO:teuthology.orchestra.run.smithi165.stdout: log flush on exit = True 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: log to file = False 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: log to stderr = True 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: osd blocked scrub grace period = 3600 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug reject backfill probability = 0.3 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: osd delete sleep = 1 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: osd max backfills = 3 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: osd max markdown count = 1000 2024-04-25T09:27:06.550 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub min interval = 60 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: osd shutdown pgref assert = True 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: osd snap trim sleep = 2 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:27:06.551 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-04-25T09:27:06.552 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:27:06.553 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: mon min osdmap epochs = 50 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: mon osdmap full prune interval = 2 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: mon osdmap full prune min = 15 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: mon osdmap full prune txsize = 2 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default crimson = True 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: paxos service trim min = 10 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-04-25T09:27:06.554 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout:[client.0] 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: debug objecter = 20 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: debug rados = 20 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.0] 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.1] 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.2] 2024-04-25T09:27:06.555 INFO:teuthology.orchestra.run.smithi165.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:27:06.556 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.3] 2024-04-25T09:27:06.556 INFO:teuthology.orchestra.run.smithi165.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:27:06.557 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-25T09:27:06.558 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.559 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:27:06.560 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = 172.21.15.165 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: ms client mode = crc 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: ms cluster mode = crc 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon client mode = crc 2024-04-25T09:27:06.561 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon cluster mode = crc 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: ms mon service mode = crc 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: ms service mode = crc 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_min_size = 2 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_size = 3 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 120 2024-04-25T09:27:06.562 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:27:06.563 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.563 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-25T09:27:06.563 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-25T09:27:06.563 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.563 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-25T09:27:06.563 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.564 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: debug monc = 20 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression algorithm = snappy 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore compression mode = aggressive 2024-04-25T09:27:06.565 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore rocksdb cf = False 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: crimson alien thread cpu cores = 6-7 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: crimson osd obc lru size = 10 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 20 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 20 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 10 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: err to stderr = True 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: log flush on exit = True 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: log to file = False 2024-04-25T09:27:06.566 INFO:teuthology.orchestra.run.smithi172.stdout: log to stderr = True 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd blocked scrub grace period = 3600 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug reject backfill probability = 0.3 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd delete sleep = 1 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd max backfills = 3 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd max markdown count = 1000 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub min interval = 60 2024-04-25T09:27:06.567 INFO:teuthology.orchestra.run.smithi172.stdout: osd shutdown pgref assert = True 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: osd snap trim sleep = 2 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-25T09:27:06.568 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T09:27:06.569 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-25T09:27:06.569 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-25T09:27:06.569 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-25T09:27:06.569 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-25T09:27:06.569 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-25T09:27:06.569 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:27:06.570 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-25T09:27:06.570 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-25T09:27:06.570 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:27:06.570 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: mon min osdmap epochs = 50 2024-04-25T09:27:06.571 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune interval = 2 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune min = 15 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: mon osdmap full prune txsize = 2 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default crimson = True 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: paxos service trim min = 10 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-25T09:27:06.572 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout: debug objecter = 20 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout: debug rados = 20 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 0-2 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2024-04-25T09:27:06.573 INFO:teuthology.orchestra.run.smithi172.stdout: crimson seastar cpu cores = 3-5 2024-04-25T09:27:06.573 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T09:27:06.574 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T09:27:06.663 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T09:27:06.663 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:06.663 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T09:27:06.678 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:06.678 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T09:27:06.732 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T09:27:06.733 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:06.733 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:27:06.733 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:27:06.805 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:06.805 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:06.860 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T09:27:06.860 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:06.860 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:27:06.860 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:27:06.894 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:06.894 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:06.949 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T09:27:06.949 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T09:27:06.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:27:07.071 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:27:07.075 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T09:27:07.075 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T09:27:07.075 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T09:27:07.122 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T09:27:07.134 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T09:27:07.183 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T09:27:07.195 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T09:27:07.195 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-25T09:27:07.195 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T09:27:07.219 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-25T09:27:07.219 INFO:tasks.ceph:role: osd.0 2024-04-25T09:27:07.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T09:27:07.219 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:27:07.289 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:27:07.290 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:27:07.810 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-04-25T09:27:07.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-04-25T09:27:07.812 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T09:27:07.960 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T09:27:07.994 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T09:27:08.061 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-25T09:27:08.061 INFO:tasks.ceph:role: osd.1 2024-04-25T09:27:08.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T09:27:08.061 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:27:08.133 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:27:08.134 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:27:08.576 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-04-25T09:27:08.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-04-25T09:27:08.578 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T09:27:08.663 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T09:27:08.734 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:09.048 INFO:teuthology.orchestra.run.smithi165.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:09.049 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:09,065 seastar - Reactor backend: linux-aio 2024-04-25T09:27:09.064 INFO:teuthology.orchestra.run.smithi165.stderr:==26501==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:09,196 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:27:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:09,196 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-25T09:27:09.181 INFO:teuthology.orchestra.run.smithi165.stderr:DEBUG 2024-04-25 09:27:09,197 [shard 0:main] seastar - reactor::drain 2024-04-25T09:27:09.728 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:09.728 INFO:teuthology.orchestra.run.smithi165.stderr:Suppressions used: 2024-04-25T09:27:09.728 INFO:teuthology.orchestra.run.smithi165.stderr: count bytes template 2024-04-25T09:27:09.728 INFO:teuthology.orchestra.run.smithi165.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:09.729 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:09.729 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:27:09.786 INFO:teuthology.orchestra.run.smithi165.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:09.790 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:09,806 seastar - Reactor backend: linux-aio 2024-04-25T09:27:09.799 INFO:teuthology.orchestra.run.smithi165.stderr:==26499==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:14.436 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:14.437 INFO:teuthology.orchestra.run.smithi165.stderr:Suppressions used: 2024-04-25T09:27:14.437 INFO:teuthology.orchestra.run.smithi165.stderr: count bytes template 2024-04-25T09:27:14.437 INFO:teuthology.orchestra.run.smithi165.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:14.437 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:14.437 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:27:14.437 INFO:teuthology.orchestra.run.smithi165.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:14.459 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T09:27:14.483 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:14.768 INFO:teuthology.orchestra.run.smithi165.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:14.769 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:14,785 seastar - Reactor backend: linux-aio 2024-04-25T09:27:14.774 INFO:teuthology.orchestra.run.smithi165.stderr:==26684==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:14.877 INFO:teuthology.orchestra.run.smithi165.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x37f0304 0x4351a3c 0x43f7bcb 0x5de722d 0x5de745e 0x5dc3bf5 0x5c088dd 0x5c239a1 0x6efc314 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x37e691a 0x37e7473 0x3686d7a 0x2958f 0x2963f 0x3473444 2024-04-25T09:27:14.877 INFO:teuthology.orchestra.run.smithi165.stderr:kernel callstack: 2024-04-25T09:27:14.888 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:14,903 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:27:14.888 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:14,903 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-25T09:27:14.888 INFO:teuthology.orchestra.run.smithi165.stderr:DEBUG 2024-04-25 09:27:14,904 [shard 0:main] seastar - reactor::drain 2024-04-25T09:27:15.428 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:15.429 INFO:teuthology.orchestra.run.smithi165.stderr:Suppressions used: 2024-04-25T09:27:15.429 INFO:teuthology.orchestra.run.smithi165.stderr: count bytes template 2024-04-25T09:27:15.429 INFO:teuthology.orchestra.run.smithi165.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:15.429 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:15.429 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:27:15.485 INFO:teuthology.orchestra.run.smithi165.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:15.488 INFO:teuthology.orchestra.run.smithi165.stderr:INFO 2024-04-25 09:27:15,504 seastar - Reactor backend: linux-aio 2024-04-25T09:27:15.504 INFO:teuthology.orchestra.run.smithi165.stderr:==26682==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:15.598 INFO:teuthology.orchestra.run.smithi165.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x35b70 0x3689e 0x369d5e8 0x5e44926 0x5e44b59 0x5dc3640 0x5dc381a 0x5dc3da6 0x5c088dd 0x5c239a1 0x6efc314 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x368758a 0x2958f 0x2963f 0x3473444 2024-04-25T09:27:15.598 INFO:teuthology.orchestra.run.smithi165.stderr:kernel callstack: 2024-04-25T09:27:20.139 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:20.139 INFO:teuthology.orchestra.run.smithi165.stderr:Suppressions used: 2024-04-25T09:27:20.139 INFO:teuthology.orchestra.run.smithi165.stderr: count bytes template 2024-04-25T09:27:20.139 INFO:teuthology.orchestra.run.smithi165.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:20.139 INFO:teuthology.orchestra.run.smithi165.stderr:----------------------------------------------------- 2024-04-25T09:27:20.139 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:27:20.139 INFO:teuthology.orchestra.run.smithi165.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:20.160 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T09:27:20.184 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T09:27:20.213 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-25T09:27:20.213 INFO:tasks.ceph:role: osd.2 2024-04-25T09:27:20.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T09:27:20.214 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:27:20.287 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:27:20.288 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:27:20.800 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-25T09:27:20.802 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-25T09:27:20.802 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-25T09:27:20.940 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T09:27:20.973 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T09:27:21.040 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-25T09:27:21.041 INFO:tasks.ceph:role: osd.3 2024-04-25T09:27:21.041 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T09:27:21.041 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:27:21.115 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:27:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:27:21.115 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:27:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T09:27:21.116 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:27:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:27:21.116 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:27:21.116 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T09:27:21.116 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:27:21.116 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:27:21.565 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-25T09:27:21.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-25T09:27:21.568 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-04-25T09:27:21.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T09:27:21.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:21.980 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:21.981 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:21,996 seastar - Reactor backend: linux-aio 2024-04-25T09:27:21.992 INFO:teuthology.orchestra.run.smithi172.stderr:==26425==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:22.107 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:22,122 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:27:22.107 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:22,123 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-25T09:27:22.107 INFO:teuthology.orchestra.run.smithi172.stderr:DEBUG 2024-04-25 09:27:22,123 [shard 0:main] seastar - reactor::drain 2024-04-25T09:27:22.646 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:22.646 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-04-25T09:27:22.647 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-04-25T09:27:22.647 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:22.647 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:22.647 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T09:27:22.707 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:22.711 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:22,727 seastar - Reactor backend: linux-aio 2024-04-25T09:27:22.720 INFO:teuthology.orchestra.run.smithi172.stderr:==26423==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:27.371 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:27.372 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-04-25T09:27:27.372 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-04-25T09:27:27.372 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:27.372 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:27.372 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T09:27:27.372 INFO:teuthology.orchestra.run.smithi172.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:27.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T09:27:27.419 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:27.705 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:27.705 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:27,721 seastar - Reactor backend: linux-aio 2024-04-25T09:27:27.711 INFO:teuthology.orchestra.run.smithi172.stderr:==26607==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:27.814 INFO:teuthology.orchestra.run.smithi172.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9f08b9 0xb8c3380 0xb8c48fc 0xb8c4b12 0xb8c4c68 0xb8c5131 0x3e6ef 0x5df596b 0x5df5c0c 0x5df5e3d 0x5df6113 0x5e44953 0x5e44b59 0x5dc3640 0x5dc381a 0x5dc3da6 0x5c088dd 0x5c239a1 0x6efc314 0x6f0dae7 0x6f0ef84 0x6f0f009 0x6f0f10b 0x6f0f203 0x6f0f410 0x6f0f5f6 0x6f0f945 0x6f0fce9 0x6f0ff19 0x6f10183 0x6f10450 0x6f1066e 0x6f10726 0x6f107ec 0x6f108cd 0x5a711d6 0x5a712e0 0x5a7139c 0x5a71458 0x5a71514 0x5a71661 0x5a717ec 0x5a71bad 0x5a8daee 0xb8d6005 0xb8f029f 0xb99129d 0xb9928eb 0xb66f0d1 0xb66fa4d 0x37e691a 0x37e7473 0x3686d7a 0x2958f 0x2963f 0x3473444 2024-04-25T09:27:27.814 INFO:teuthology.orchestra.run.smithi172.stderr:kernel callstack: 2024-04-25T09:27:27.823 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:27,839 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-25T09:27:27.823 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:27,839 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-25T09:27:27.823 INFO:teuthology.orchestra.run.smithi172.stderr:DEBUG 2024-04-25 09:27:27,840 [shard 0:main] seastar - reactor::drain 2024-04-25T09:27:28.358 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:28.358 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-04-25T09:27:28.358 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-04-25T09:27:28.359 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:28.359 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:28.359 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T09:27:28.414 INFO:teuthology.orchestra.run.smithi172.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-25T09:27:28.417 INFO:teuthology.orchestra.run.smithi172.stderr:INFO 2024-04-25 09:27:28,433 seastar - Reactor backend: linux-aio 2024-04-25T09:27:28.435 INFO:teuthology.orchestra.run.smithi172.stderr:==26605==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-25T09:27:33.059 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:33.059 INFO:teuthology.orchestra.run.smithi172.stderr:Suppressions used: 2024-04-25T09:27:33.059 INFO:teuthology.orchestra.run.smithi172.stderr: count bytes template 2024-04-25T09:27:33.059 INFO:teuthology.orchestra.run.smithi172.stderr: 1 8 MallocExtension::Register 2024-04-25T09:27:33.059 INFO:teuthology.orchestra.run.smithi172.stderr:----------------------------------------------------- 2024-04-25T09:27:33.059 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T09:27:33.060 INFO:teuthology.orchestra.run.smithi172.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:33.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T09:27:33.105 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T09:27:33.105 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:33.106 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T09:27:33.135 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:33.135 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T09:27:33.202 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:33.202 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T09:27:33.225 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:33.225 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T09:27:33.288 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:33.288 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T09:27:33.352 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:33.352 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T09:27:33.369 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:33.369 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T09:27:33.407 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T09:27:33.407 DEBUG:teuthology.orchestra.run.smithi165:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:27:33.432 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.0] 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDtISpmXM6lOBAAyhn1FA+348YditnMN5CUUQ== 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.1] 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDzISpmrhCUJxAAfoHt/P0R3VEJ+D1Wjj3TTw== 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.x] 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDrISpm81U8BRAA07zFrQG9BpBFhsW5tZQsqg== 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.2] 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQD6ISpmbL1CNBAAGB14r7/6xkZWM4kHM5O8yA== 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.3] 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQAAIipmwOMPIxAAZtOSNBW+dkKQEfk8Fo66IA== 2024-04-25T09:27:33.433 INFO:teuthology.orchestra.run.smithi165.stdout:[client.0] 2024-04-25T09:27:33.434 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDrISpmduU9CBAAzuEqn9HNB1GZ9jciJPN6mQ== 2024-04-25T09:27:33.434 INFO:teuthology.orchestra.run.smithi165.stdout:[client.1] 2024-04-25T09:27:33.434 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDrISpm6w7ZCxAAu+LuvG4yZ7nkWZ2LTJD1Jg== 2024-04-25T09:27:33.435 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:27:33.537 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:27:33.597 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:27:33.656 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:27:33.715 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:27:33.774 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:27:33.836 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:27:33.898 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T09:27:33.898 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T09:27:33.922 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:27:34.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:34.048+0000 7f27c0068a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:34.048+0000 7f27c0068a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.049 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T09:27:34.073 DEBUG:teuthology.orchestra.run.smithi165:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:27:34.128 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T09:27:34.128 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T09:27:34.128 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T09:27:34.170 INFO:tasks.ceph.mon.a:Started 2024-04-25T09:27:34.170 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T09:27:34.171 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T09:27:34.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T09:27:34.173 INFO:tasks.ceph.mgr.x:Started 2024-04-25T09:27:34.173 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T09:27:34.173 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T09:27:34.250 INFO:tasks.ceph.mon.a.smithi165.stderr:2024-04-25T09:27:34.264+0000 7fcc63262a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.250 INFO:tasks.ceph.mon.a.smithi165.stderr:2024-04-25T09:27:34.265+0000 7fcc63262a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.250 INFO:tasks.ceph.mon.a.smithi165.stderr:2024-04-25T09:27:34.265+0000 7fcc63262a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.265 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.280+0000 7f50aaeff000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:34.291+0000 7fd4f66ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.283 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.298+0000 7f50aaeff000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.284 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.298+0000 7f50aaeff000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:34.300+0000 7fd4f66ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.355 INFO:teuthology.orchestra.run.smithi165.stderr:adjusted tunables profile to default 2024-04-25T09:27:34.367 INFO:tasks.ceph:check_enable_crimson: True 2024-04-25T09:27:34.367 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-04-25T09:27:34.367 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-04-25T09:27:34.385 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.400+0000 7f50aaeff000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:27:34.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:34.481+0000 7f983bcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:34.489+0000 7f983bcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:34.534 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.549+0000 7f50aaeff000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:27:34.554 INFO:tasks.ceph.mon.a.smithi165.stderr:2024-04-25T09:27:34.569+0000 7fcc59bf4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-04-25T09:27:34.554 INFO:tasks.ceph.mon.a.smithi165.stderr:Please be aware that this feature is experimental, untested, 2024-04-25T09:27:34.554 INFO:tasks.ceph.mon.a.smithi165.stderr:unsupported, and may result in data corruption, data loss, 2024-04-25T09:27:34.554 INFO:tasks.ceph.mon.a.smithi165.stderr:and/or irreparable damage to your cluster. Do not use 2024-04-25T09:27:34.555 INFO:tasks.ceph.mon.a.smithi165.stderr:feature with important data. 2024-04-25T09:27:34.555 INFO:tasks.ceph.mon.a.smithi165.stderr: 2024-04-25T09:27:34.587 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.602+0000 7f50aaeff000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:27:34.827 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.841+0000 7f50aaeff000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:27:34.871 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:34.886+0000 7f50aaeff000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:27:35.369 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T09:27:35.369 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:35.369 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T09:27:35.394 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-04-25T09:27:35.395 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T09:27:35.460 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:35.460 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T09:27:35.485 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-25T09:27:35.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T09:27:35.549 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new af2442cd-f1c9-4186-bdf0-ab333222ed5b 0 2024-04-25T09:27:35.570 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:35.584+0000 7f50aaeff000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:27:35.663 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:35.678+0000 7f50aaeff000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:27:35.675 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:35.684+0000 7fe39246d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:35.678 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:35.693+0000 7fe39246d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:35.707 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:35.722+0000 7f50aaeff000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:27:35.757 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-04-25T09:27:35.768 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 7da7b933-c457-4964-a7fc-3836a553a9e9 1 2024-04-25T09:27:35.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:35.882+0000 7f7664cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:35.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:35.891+0000 7f7664cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:35.881 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:35.896+0000 7f50aaeff000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:27:35.929 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:35.944+0000 7f50aaeff000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:27:35.954 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-25T09:27:35.965 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 79f2c880-b5ea-4a4a-b956-def489fb2147 2 2024-04-25T09:27:35.984 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:35.998+0000 7f50aaeff000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:27:36.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:36.079+0000 7f29b002d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:36.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:36.088+0000 7f29b002d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:36.102 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:36.116+0000 7f50aaeff000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:27:36.152 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-04-25T09:27:36.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 8bb3a063-42d3-47b0-86ee-5ae57576a4cb 3 2024-04-25T09:27:36.310 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:36.318+0000 7f168a55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:36.313 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-25T09:27:36.327+0000 7f168a55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:36.394 INFO:teuthology.orchestra.run.smithi172.stdout:3 2024-04-25T09:27:36.405 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-04-25T09:27:36.439 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T09:27:36.439 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-04-25T09:27:36.482 INFO:tasks.ceph.osd.0:Started 2024-04-25T09:27:36.482 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-04-25T09:27:36.494 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:36.507+0000 7f50aaeff000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T09:27:36.514 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T09:27:36.514 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-04-25T09:27:36.557 INFO:tasks.ceph.osd.1:Started 2024-04-25T09:27:36.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-04-25T09:27:36.586 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T09:27:36.586 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-04-25T09:27:36.628 INFO:tasks.ceph.osd.2:Started 2024-04-25T09:27:36.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-04-25T09:27:36.656 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T09:27:36.656 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-04-25T09:27:36.698 INFO:tasks.ceph.osd.3:Started 2024-04-25T09:27:36.699 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:27:36.767 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:36.780+0000 7f50aaeff000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:27:36.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:36.826+0000 7f828daad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:36.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:36.834+0000 7f828daad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:36.827 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:36.841+0000 7f50aaeff000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:27:36.887 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:36.888 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":7,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:27:36.408151+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:27:36.899 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T09:27:36.900 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T09:27:36.977 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:36.990+0000 7f50aaeff000 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T09:27:37.302 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:27:37.406 INFO:teuthology.misc.health.smithi165.stderr:2024-04-25T09:27:37.417+0000 7f11bff5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:37.410 INFO:teuthology.misc.health.smithi165.stderr:2024-04-25T09:27:37.425+0000 7f11bff5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:37.469 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:37.483+0000 7f50aaeff000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:27:37.479 INFO:teuthology.misc.health.smithi165.stdout: 2024-04-25T09:27:37.479 INFO:teuthology.misc.health.smithi165.stdout:{"epoch":7,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:27:36.408151+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:27:37.493 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-25T09:27:37.544 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:37.558+0000 7f50aaeff000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:27:37.808 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:37.822+0000 7f50aaeff000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:27:38.018 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:38.032+0000 7f50aaeff000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:27:38.101 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:38.114+0000 7f50aaeff000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:27:38.217 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:38.231+0000 7f50aaeff000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:27:38.289 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:38.302+0000 7f50aaeff000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:27:39.054 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:39.069+0000 7f50aaeff000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:27:39.201 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:39.216+0000 7f50aaeff000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:27:40.210 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-25T09:27:40.225+0000 7f504a581640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-25T09:27:43.896 DEBUG:teuthology.orchestra.run.smithi165:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:27:44.008 INFO:teuthology.misc.health.smithi165.stderr:2024-04-25T09:27:44.019+0000 7f21a302d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:44.011 INFO:teuthology.misc.health.smithi165.stderr:2024-04-25T09:27:44.026+0000 7f21a302d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:44.203 INFO:teuthology.misc.health.smithi165.stdout: 2024-04-25T09:27:44.203 INFO:teuthology.misc.health.smithi165.stdout:{"epoch":11,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:27:43.392388+0000","last_up_change":"2024-04-25T09:27:42.387533+0000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:27:43.240966+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1904214635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1904214635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1904214635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":1904214635}]},"public_addr":"172.21.15.165:6805/1904214635","cluster_addr":"172.21.15.165:6804/1904214635","heartbeat_back_addr":"172.21.15.165:6812/1904214635","heartbeat_front_addr":"172.21.15.165:6813/1904214635","state":["exists","up"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3016225021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":3016225021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":3016225021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3016225021}]},"public_addr":"172.21.15.165:6802/3016225021","cluster_addr":"172.21.15.165:6801/3016225021","heartbeat_back_addr":"172.21.15.165:6817/3016225021","heartbeat_front_addr":"172.21.15.165:6816/3016225021","state":["exists","up"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":2001234603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2001234603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2001234603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2001234603}]},"public_addr":"172.21.15.172:6805/2001234603","cluster_addr":"172.21.15.172:6804/2001234603","heartbeat_back_addr":"172.21.15.172:6812/2001234603","heartbeat_front_addr":"172.21.15.172:6809/2001234603","state":["exists","up"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":768266283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":768266283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":768266283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":768266283}]},"public_addr":"172.21.15.172:6811/768266283","cluster_addr":"172.21.15.172:6810/768266283","heartbeat_back_addr":"172.21.15.172:6807/768266283","heartbeat_front_addr":"172.21.15.172:6808/768266283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:27:44.215 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-25T09:27:44.215 INFO:tasks.ceph:Creating RBD pool 2024-04-25T09:27:44.215 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T09:27:44.322 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:44.330+0000 7fb22dcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:44.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:44.341+0000 7fb22dcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:45.448 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'rbd' created 2024-04-25T09:27:45.464 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T09:27:45.603 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:45.608+0000 7fbc3c59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:45.607 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:45.622+0000 7fbc3c59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:46.449 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T09:27:46.465 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T09:27:46.466 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T09:27:46.466 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T09:27:46.466 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T09:27:46.466 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T09:27:46.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:46.622+0000 7fa3b54ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:46.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:46.630+0000 7fa3b54ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:46.853 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:46.864 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1325124375},{"type":"v1","addr":"172.21.15.172:6801","nonce":1325124375}]},"active_addr":"172.21.15.172:6801/1325124375","active_change":"2024-04-25T09:27:39.218651+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3149740806}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3618796771}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1281723126}]}]} 2024-04-25T09:27:46.866 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T09:27:46.866 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T09:27:46.866 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:27:46.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:46.983+0000 7f7ab4d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:46.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:46.991+0000 7f7ab4d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.166 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:47.166 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":14,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:27:46.463958+0000","last_up_change":"2024-04-25T09:27:42.387533+0000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:27:43.240966+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:27:44.537853+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1904214635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1904214635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1904214635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":1904214635}]},"public_addr":"172.21.15.165:6805/1904214635","cluster_addr":"172.21.15.165:6804/1904214635","heartbeat_back_addr":"172.21.15.165:6812/1904214635","heartbeat_front_addr":"172.21.15.165:6813/1904214635","state":["exists","up"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3016225021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":3016225021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":3016225021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3016225021}]},"public_addr":"172.21.15.165:6802/3016225021","cluster_addr":"172.21.15.165:6801/3016225021","heartbeat_back_addr":"172.21.15.165:6817/3016225021","heartbeat_front_addr":"172.21.15.165:6816/3016225021","state":["exists","up"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":2001234603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2001234603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2001234603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2001234603}]},"public_addr":"172.21.15.172:6805/2001234603","cluster_addr":"172.21.15.172:6804/2001234603","heartbeat_back_addr":"172.21.15.172:6812/2001234603","heartbeat_front_addr":"172.21.15.172:6809/2001234603","state":["exists","up"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":768266283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":768266283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":768266283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":768266283}]},"public_addr":"172.21.15.172:6811/768266283","cluster_addr":"172.21.15.172:6810/768266283","heartbeat_back_addr":"172.21.15.172:6807/768266283","heartbeat_front_addr":"172.21.15.172:6808/768266283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:27:47.179 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T09:27:47.179 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:27:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.297+0000 7f1e68d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.290 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.305+0000 7f1e68d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.490 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:47.490 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":15,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:27:47.465103+0000","last_up_change":"2024-04-25T09:27:42.387533+0000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:27:43.240966+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:27:44.537853+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1904214635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1904214635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1904214635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":1904214635}]},"public_addr":"172.21.15.165:6805/1904214635","cluster_addr":"172.21.15.165:6804/1904214635","heartbeat_back_addr":"172.21.15.165:6812/1904214635","heartbeat_front_addr":"172.21.15.165:6813/1904214635","state":["exists","up"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3016225021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":3016225021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":3016225021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3016225021}]},"public_addr":"172.21.15.165:6802/3016225021","cluster_addr":"172.21.15.165:6801/3016225021","heartbeat_back_addr":"172.21.15.165:6817/3016225021","heartbeat_front_addr":"172.21.15.165:6816/3016225021","state":["exists","up"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":2001234603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2001234603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2001234603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2001234603}]},"public_addr":"172.21.15.172:6805/2001234603","cluster_addr":"172.21.15.172:6804/2001234603","heartbeat_back_addr":"172.21.15.172:6812/2001234603","heartbeat_front_addr":"172.21.15.172:6809/2001234603","state":["exists","up"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":768266283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":768266283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":768266283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":768266283}]},"public_addr":"172.21.15.172:6811/768266283","cluster_addr":"172.21.15.172:6810/768266283","heartbeat_back_addr":"172.21.15.172:6807/768266283","heartbeat_front_addr":"172.21.15.172:6808/768266283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:27:47.503 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T09:27:47.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T09:27:47.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T09:27:47.505 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T09:27:47.624 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.634+0000 7f5cdc59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.634+0000 7f9aa9c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.634+0000 7fc53b42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.634+0000 7fa88b86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.643+0000 7f9aa9c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.643+0000 7f5cdc59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.644+0000 7fc53b42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.644+0000 7fa88b86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.661 INFO:teuthology.orchestra.run.smithi165.stdout:42949672965 2024-04-25T09:27:47.661 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:27:47.664 INFO:teuthology.orchestra.run.smithi165.stdout:42949672965 2024-04-25T09:27:47.664 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:27:47.667 INFO:teuthology.orchestra.run.smithi165.stdout:38654705670 2024-04-25T09:27:47.667 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:27:47.668 INFO:teuthology.orchestra.run.smithi165.stdout:38654705670 2024-04-25T09:27:47.669 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:27:47.774 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.784+0000 7f551a2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.788+0000 7faf8df9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.794+0000 7f551a2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.784 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.799+0000 7faf8df9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.835+0000 7f0292cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.836+0000 7f8b5cc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.845+0000 7f8b5cc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:47.845+0000 7f0292cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:47.992 INFO:teuthology.orchestra.run.smithi165.stdout:42949672965 2024-04-25T09:27:48.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.3 2024-04-25T09:27:48.005 DEBUG:teuthology.parallel:result is None 2024-04-25T09:27:48.019 INFO:teuthology.orchestra.run.smithi165.stdout:42949672965 2024-04-25T09:27:48.031 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:48.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.2 2024-04-25T09:27:48.032 DEBUG:teuthology.parallel:result is None 2024-04-25T09:27:48.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-04-25T09:27:48.056 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:48.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2024-04-25T09:27:49.045 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:27:49.070 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:27:49.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:49.168+0000 7ff274620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:49.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:49.178+0000 7ff274620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:49.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:49.211+0000 7fcee895d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:49.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:49.220+0000 7fcee895d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:49.362 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:49.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-04-25T09:27:49.398 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:49.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2024-04-25T09:27:50.376 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:27:50.412 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:27:50.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:50.499+0000 7f248555d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:50.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:50.509+0000 7f248555d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:50.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:50.546+0000 7f288dd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:50.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:50.555+0000 7f288dd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:50.714 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:50.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-04-25T09:27:50.751 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:50.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2024-04-25T09:27:51.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:27:51.766 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:27:51.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:51.859+0000 7fc2bb42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:51.855 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:51.870+0000 7fc2bb42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:51.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:51.896+0000 7fa73079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:51.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:51.905+0000 7fa73079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:52.048 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:52.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-04-25T09:27:52.084 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:52.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2024-04-25T09:27:53.062 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:27:53.098 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:27:53.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:53.186+0000 7fe968b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:53.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:53.196+0000 7fe968b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:53.220 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:53.229+0000 7f193d620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:53.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:53.238+0000 7f193d620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:53.382 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:53.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-04-25T09:27:53.421 INFO:teuthology.orchestra.run.smithi165.stdout:38654705669 2024-04-25T09:27:53.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2024-04-25T09:27:54.397 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:27:54.435 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:27:54.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:54.522+0000 7f26b406d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:54.532+0000 7f26b406d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:54.632+0000 7f1615ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:54.640+0000 7f1615ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.723 INFO:teuthology.orchestra.run.smithi165.stdout:38654705674 2024-04-25T09:27:54.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705674 for osd.0 2024-04-25T09:27:54.736 DEBUG:teuthology.parallel:result is None 2024-04-25T09:27:54.821 INFO:teuthology.orchestra.run.smithi165.stdout:38654705674 2024-04-25T09:27:54.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705674 for osd.1 2024-04-25T09:27:54.834 DEBUG:teuthology.parallel:result is None 2024-04-25T09:27:54.834 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:27:54.834 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:27:54.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:54.953+0000 7fd1e4b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:54.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:54.960+0000 7fd1e4b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.128 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:55.128 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:27:55.141 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-25T09:27:53.224747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":667648,"data_stored":1892162,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.810771"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.566172+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:27:46.566172+0000","last_peered":"2024-04-25T09:27:46.566172+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:27:46.566172+0000","last_undegraded":"2024-04-25T09:27:46.566172+0000","last_fullsized":"2024-04-25T09:27:46.566172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488040+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:27:47.488040+0000","last_peered":"2024-04-25T09:27:47.488040+0000","last_clean":"2024-04-25T09:27:47.488040+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:27:47.488040+0000","last_undegraded":"2024-04-25T09:27:47.488040+0000","last_fullsized":"2024-04-25T09:27:47.488040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.583673+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:27:46.583673+0000","last_peered":"2024-04-25T09:27:46.583673+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:27:46.583673+0000","last_undegraded":"2024-04-25T09:27:46.583673+0000","last_fullsized":"2024-04-25T09:27:46.583673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488360+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:27:47.488360+0000","last_peered":"2024-04-25T09:27:47.488360+0000","last_clean":"2024-04-25T09:27:47.488360+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:27:47.488360+0000","last_undegraded":"2024-04-25T09:27:47.488360+0000","last_fullsized":"2024-04-25T09:27:47.488360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.564325+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:27:46.564325+0000","last_peered":"2024-04-25T09:27:46.564325+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:27:46.564325+0000","last_undegraded":"2024-04-25T09:27:46.564325+0000","last_fullsized":"2024-04-25T09:27:46.564325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.538567+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:27:46.538567+0000","last_peered":"2024-04-25T09:27:46.538567+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:27:46.538567+0000","last_undegraded":"2024-04-25T09:27:46.538567+0000","last_fullsized":"2024-04-25T09:27:46.538567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.575518+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:27:46.575518+0000","last_peered":"2024-04-25T09:27:46.575518+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:27:46.575518+0000","last_undegraded":"2024-04-25T09:27:46.575518+0000","last_fullsized":"2024-04-25T09:27:46.575518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.559113+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:27:46.559113+0000","last_peered":"2024-04-25T09:27:46.559113+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:27:46.559113+0000","last_undegraded":"2024-04-25T09:27:46.559113+0000","last_fullsized":"2024-04-25T09:27:46.559113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.474969+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:27:46.474969+0000","last_peered":"2024-04-25T09:27:46.474969+0000","last_clean":"2024-04-25T09:27:46.474969+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:27:46.474969+0000","last_undegraded":"2024-04-25T09:27:46.474969+0000","last_fullsized":"2024-04-25T09:27:46.474969+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":118784,"data_stored":29462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:27:55.141 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:27:55.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:55.260+0000 7f9e7662d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:55.267+0000 7f9e7662d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.436 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:55.437 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:27:55.449 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-04-25T09:27:55.225316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":667648,"data_stored":1892162,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.811340"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.566172+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:27:46.566172+0000","last_peered":"2024-04-25T09:27:46.566172+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:27:46.566172+0000","last_undegraded":"2024-04-25T09:27:46.566172+0000","last_fullsized":"2024-04-25T09:27:46.566172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488040+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:27:47.488040+0000","last_peered":"2024-04-25T09:27:47.488040+0000","last_clean":"2024-04-25T09:27:47.488040+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:27:47.488040+0000","last_undegraded":"2024-04-25T09:27:47.488040+0000","last_fullsized":"2024-04-25T09:27:47.488040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.583673+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:27:46.583673+0000","last_peered":"2024-04-25T09:27:46.583673+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:27:46.583673+0000","last_undegraded":"2024-04-25T09:27:46.583673+0000","last_fullsized":"2024-04-25T09:27:46.583673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488360+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:27:47.488360+0000","last_peered":"2024-04-25T09:27:47.488360+0000","last_clean":"2024-04-25T09:27:47.488360+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:27:47.488360+0000","last_undegraded":"2024-04-25T09:27:47.488360+0000","last_fullsized":"2024-04-25T09:27:47.488360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.564325+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:27:46.564325+0000","last_peered":"2024-04-25T09:27:46.564325+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:27:46.564325+0000","last_undegraded":"2024-04-25T09:27:46.564325+0000","last_fullsized":"2024-04-25T09:27:46.564325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.538567+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:27:46.538567+0000","last_peered":"2024-04-25T09:27:46.538567+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:27:46.538567+0000","last_undegraded":"2024-04-25T09:27:46.538567+0000","last_fullsized":"2024-04-25T09:27:46.538567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.575518+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:27:46.575518+0000","last_peered":"2024-04-25T09:27:46.575518+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:27:46.575518+0000","last_undegraded":"2024-04-25T09:27:46.575518+0000","last_fullsized":"2024-04-25T09:27:46.575518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.559113+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:27:46.559113+0000","last_peered":"2024-04-25T09:27:46.559113+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:27:46.559113+0000","last_undegraded":"2024-04-25T09:27:46.559113+0000","last_fullsized":"2024-04-25T09:27:46.559113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.474969+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:27:46.474969+0000","last_peered":"2024-04-25T09:27:46.474969+0000","last_clean":"2024-04-25T09:27:46.474969+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:27:46.474969+0000","last_undegraded":"2024-04-25T09:27:46.474969+0000","last_fullsized":"2024-04-25T09:27:46.474969+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":118784,"data_stored":29462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:27:55.450 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:27:55.450 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T09:27:55.450 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T09:27:55.450 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:27:55.556 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:55.568+0000 7ff18c02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:55.574+0000 7ff18c02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.788 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:55.788 INFO:teuthology.orchestra.run.smithi165.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:27:55.801 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T09:27:55.802 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-25T09:27:55.813 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-25T09:27:55.813 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-matanb-crimson-testing-april-22'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'a126334d8733673d119ffdf40d6ae4b541a0a1cd'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '472cc2b524a88306ef4535053d26658c5fd6e9db'}} 2024-04-25T09:27:55.813 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-25T09:27:55.813 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-25T09:27:55.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:55.931+0000 7f7a0fb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:55.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:55.942+0000 7f7a0fb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.132 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-25T09:27:56.132 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:27:56.132 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:27:56.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:56.251+0000 7f198426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:56.258+0000 7f198426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.430 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:56.430 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:27:56.442 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-04-25T09:27:55.225316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":667648,"data_stored":1892162,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.811340"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.566172+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:27:46.566172+0000","last_peered":"2024-04-25T09:27:46.566172+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:27:46.566172+0000","last_undegraded":"2024-04-25T09:27:46.566172+0000","last_fullsized":"2024-04-25T09:27:46.566172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488040+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:27:47.488040+0000","last_peered":"2024-04-25T09:27:47.488040+0000","last_clean":"2024-04-25T09:27:47.488040+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:27:47.488040+0000","last_undegraded":"2024-04-25T09:27:47.488040+0000","last_fullsized":"2024-04-25T09:27:47.488040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.583673+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:27:46.583673+0000","last_peered":"2024-04-25T09:27:46.583673+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:27:46.583673+0000","last_undegraded":"2024-04-25T09:27:46.583673+0000","last_fullsized":"2024-04-25T09:27:46.583673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488360+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:27:47.488360+0000","last_peered":"2024-04-25T09:27:47.488360+0000","last_clean":"2024-04-25T09:27:47.488360+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:27:47.488360+0000","last_undegraded":"2024-04-25T09:27:47.488360+0000","last_fullsized":"2024-04-25T09:27:47.488360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.564325+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:27:46.564325+0000","last_peered":"2024-04-25T09:27:46.564325+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:27:46.564325+0000","last_undegraded":"2024-04-25T09:27:46.564325+0000","last_fullsized":"2024-04-25T09:27:46.564325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.538567+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:27:46.538567+0000","last_peered":"2024-04-25T09:27:46.538567+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:27:46.538567+0000","last_undegraded":"2024-04-25T09:27:46.538567+0000","last_fullsized":"2024-04-25T09:27:46.538567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.575518+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:27:46.575518+0000","last_peered":"2024-04-25T09:27:46.575518+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:27:46.575518+0000","last_undegraded":"2024-04-25T09:27:46.575518+0000","last_fullsized":"2024-04-25T09:27:46.575518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.559113+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:27:46.559113+0000","last_peered":"2024-04-25T09:27:46.559113+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:27:46.559113+0000","last_undegraded":"2024-04-25T09:27:46.559113+0000","last_fullsized":"2024-04-25T09:27:46.559113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.474969+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:27:46.474969+0000","last_peered":"2024-04-25T09:27:46.474969+0000","last_clean":"2024-04-25T09:27:46.474969+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:27:46.474969+0000","last_undegraded":"2024-04-25T09:27:46.474969+0000","last_fullsized":"2024-04-25T09:27:46.474969+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":118784,"data_stored":29462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:27:56.443 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:27:56.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:56.561+0000 7f51d726d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:56.569+0000 7f51d726d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.740 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:27:56.740 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:27:56.752 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-04-25T09:27:55.225316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":667648,"data_stored":1892162,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.811340"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.566172+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:27:46.566172+0000","last_peered":"2024-04-25T09:27:46.566172+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:27:46.566172+0000","last_undegraded":"2024-04-25T09:27:46.566172+0000","last_fullsized":"2024-04-25T09:27:46.566172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488040+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:27:47.488040+0000","last_peered":"2024-04-25T09:27:47.488040+0000","last_clean":"2024-04-25T09:27:47.488040+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:27:47.488040+0000","last_undegraded":"2024-04-25T09:27:47.488040+0000","last_fullsized":"2024-04-25T09:27:47.488040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.583673+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:27:46.583673+0000","last_peered":"2024-04-25T09:27:46.583673+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:27:46.583673+0000","last_undegraded":"2024-04-25T09:27:46.583673+0000","last_fullsized":"2024-04-25T09:27:46.583673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488360+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:27:47.488360+0000","last_peered":"2024-04-25T09:27:47.488360+0000","last_clean":"2024-04-25T09:27:47.488360+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:27:47.488360+0000","last_undegraded":"2024-04-25T09:27:47.488360+0000","last_fullsized":"2024-04-25T09:27:47.488360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.564325+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:27:46.564325+0000","last_peered":"2024-04-25T09:27:46.564325+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:27:46.564325+0000","last_undegraded":"2024-04-25T09:27:46.564325+0000","last_fullsized":"2024-04-25T09:27:46.564325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.538567+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:27:46.538567+0000","last_peered":"2024-04-25T09:27:46.538567+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:27:46.538567+0000","last_undegraded":"2024-04-25T09:27:46.538567+0000","last_fullsized":"2024-04-25T09:27:46.538567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.575518+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:27:46.575518+0000","last_peered":"2024-04-25T09:27:46.575518+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:27:46.575518+0000","last_undegraded":"2024-04-25T09:27:46.575518+0000","last_fullsized":"2024-04-25T09:27:46.575518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.559113+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:27:46.559113+0000","last_peered":"2024-04-25T09:27:46.559113+0000","last_clean":"2024-04-25T09:27:45.460624+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:27:46.559113+0000","last_undegraded":"2024-04-25T09:27:46.559113+0000","last_fullsized":"2024-04-25T09:27:46.559113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-25T09:27:46.474969+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:27:46.474969+0000","last_peered":"2024-04-25T09:27:46.474969+0000","last_clean":"2024-04-25T09:27:46.474969+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:27:46.474969+0000","last_undegraded":"2024-04-25T09:27:46.474969+0000","last_fullsized":"2024-04-25T09:27:46.474969+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26940,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344900,"statfs":{"total":96636764160,"available":96609177600,"internally_reserved":0,"allocated":118784,"data_stored":29462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27012,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344828,"statfs":{"total":96636764160,"available":96609103872,"internally_reserved":0,"allocated":180224,"data_stored":619830,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:27:56.753 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:27:56.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-25T09:27:56.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:56.871+0000 7fa21a35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:56.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:56.878+0000 7fa21a35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.054 INFO:teuthology.orchestra.run.smithi165.stdout:epoch 15 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:fsid cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:created 2024-04-25T09:27:34.287002+0000 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:modified 2024-04-25T09:27:47.465103+0000 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:crush_version 4 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:full_ratio 0.95 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:backfillfull_ratio 0.9 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:nearfull_ratio 0.85 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:require_min_compat_client luminous 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:min_compat_client jewel 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:require_osd_release squid 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:stretch_mode_enabled false 2024-04-25T09:27:57.055 INFO:teuthology.orchestra.run.smithi165.stdout:allow_crimson=true 2024-04-25T09:27:57.056 INFO:teuthology.orchestra.run.smithi165.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 13 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-04-25T09:27:57.056 INFO:teuthology.orchestra.run.smithi165.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,nopgchange,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-04-25T09:27:57.056 INFO:teuthology.orchestra.run.smithi165.stdout:max_osd 4 2024-04-25T09:27:57.056 INFO:teuthology.orchestra.run.smithi165.stdout:osd.0 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.165:6805/1904214635 v2:172.21.15.165:6804/1904214635 exists,up af2442cd-f1c9-4186-bdf0-ab333222ed5b 2024-04-25T09:27:57.056 INFO:teuthology.orchestra.run.smithi165.stdout:osd.1 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.165:6802/3016225021 v2:172.21.15.165:6801/3016225021 exists,up 7da7b933-c457-4964-a7fc-3836a553a9e9 2024-04-25T09:27:57.056 INFO:teuthology.orchestra.run.smithi165.stdout:osd.2 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.172:6805/2001234603 v2:172.21.15.172:6804/2001234603 exists,up 79f2c880-b5ea-4a4a-b956-def489fb2147 2024-04-25T09:27:57.056 INFO:teuthology.orchestra.run.smithi165.stdout:osd.3 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.172:6811/768266283 v2:172.21.15.172:6810/768266283 exists,up 8bb3a063-42d3-47b0-86ee-5ae57576a4cb 2024-04-25T09:27:57.068 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.165:6805/1904214635 v2:172.21.15.165:6804/1904214635 exists,up af2442cd-f1c9-4186-bdf0-ab333222ed5b', 'osd.1 up in weight 1 up_from 9 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.165:6802/3016225021 v2:172.21.15.165:6801/3016225021 exists,up 7da7b933-c457-4964-a7fc-3836a553a9e9', 'osd.2 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.172:6805/2001234603 v2:172.21.15.172:6804/2001234603 exists,up 79f2c880-b5ea-4a4a-b956-def489fb2147', 'osd.3 up in weight 1 up_from 10 up_thru 13 down_at 0 last_clean_interval [0,0) v2:172.21.15.172:6811/768266283 v2:172.21.15.172:6810/768266283 exists,up 8bb3a063-42d3-47b0-86ee-5ae57576a4cb'] 2024-04-25T09:27:57.068 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-25T09:27:57.175 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T09:27:57.175 INFO:teuthology.orchestra.run.smithi165.stdout: "name": "mon.a", 2024-04-25T09:27:57.175 INFO:teuthology.orchestra.run.smithi165.stdout: "cluster": "ceph", 2024-04-25T09:27:57.175 INFO:teuthology.orchestra.run.smithi165.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-25T09:27:57.175 INFO:teuthology.orchestra.run.smithi165.stdout: "admin_socket_mode": "", 2024-04-25T09:27:57.175 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-25T09:27:57.176 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_client_required": "cephx, none", 2024-04-25T09:27:57.176 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_cluster_required": "cephx", 2024-04-25T09:27:57.176 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_debug": "true", 2024-04-25T09:27:57.176 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-25T09:27:57.176 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-25T09:27:57.176 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_service_required": "cephx", 2024-04-25T09:27:57.177 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-25T09:27:57.177 INFO:teuthology.orchestra.run.smithi165.stdout: "auth_supported": "cephx", 2024-04-25T09:27:57.177 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_aio": "true", 2024-04-25T09:27:57.177 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-25T09:27:57.177 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_aio_poll_ms": "250", 2024-04-25T09:27:57.177 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_aio_reap_max": "16", 2024-04-25T09:27:57.177 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_async_discard_threads": "0", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_block_size": "4096", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_debug_aio": "false", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_debug_inflight_ios": "false", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_enable_discard": "false", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_flock_retry": "3", 2024-04-25T09:27:57.178 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-25T09:27:57.179 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_inject_crash": "0", 2024-04-25T09:27:57.179 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-25T09:27:57.179 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_ioring": "false", 2024-04-25T09:27:57.179 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_ioring_hipri": "false", 2024-04-25T09:27:57.179 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-25T09:27:57.180 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-25T09:27:57.180 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-25T09:27:57.180 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-25T09:27:57.180 INFO:teuthology.orchestra.run.smithi165.stdout: "bdev_type": "", 2024-04-25T09:27:57.180 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_alloc_size": "1048576", 2024-04-25T09:27:57.180 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_allocator": "hybrid", 2024-04-25T09:27:57.180 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_buffered_io": "true", 2024-04-25T09:27:57.181 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_check_for_zeros": "false", 2024-04-25T09:27:57.181 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-25T09:27:57.181 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-25T09:27:57.181 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_compact_log_sync": "false", 2024-04-25T09:27:57.181 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_max_log_runway": "4194304", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_max_prefetch": "1048576", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_min_flush_size": "524288", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_min_log_runway": "1048576", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_replay_recovery": "false", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-25T09:27:57.182 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_sync_write": "false", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_allocation_from_file": "true", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_allocator": "hybrid", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-25T09:27:57.183 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_create": "true", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_db_create": "false", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_db_path": "", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_db_size": "0", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_path": "", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_preallocate_file": "false", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_size": "107374182400", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_wal_create": "false", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_wal_path": "", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_block_wal_size": "100663296", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_bluefs": "true", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-25T09:27:57.184 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_autotune": "true", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_size": "0", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-25T09:27:57.185 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_type": "2q", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_clone_cow": "true", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_mode": "none", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-25T09:27:57.186 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_csum_type": "crc32c", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_freelist": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-25T09:27:57.187 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_small_allocations": "0", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_default_buffered_read": "true", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_default_buffered_write": "false", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-25T09:27:57.188 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fail_eio": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_on_mount": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_on_umount": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-25T09:27:57.189 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_ignore_data_csum": "false", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_log_op_age": "5.000000", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_max_alloc_size": "0", 2024-04-25T09:27:57.190 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_max_blob_size": "0", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_max_deferred_txc": "32", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_min_alloc_size": "0", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_nid_prealloc": "1024", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_retry_disk_reads": "3", 2024-04-25T09:27:57.191 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_rocksdb_cf": "true", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_spdk_mem": "512", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-25T09:27:57.192 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_tracing": "false", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-25T09:27:57.193 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_zero_block_detection": "false", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-25T09:27:57.194 INFO:teuthology.orchestra.run.smithi165.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephx_cluster_require_signatures": "false", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephx_cluster_require_version": "2", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephx_require_signatures": "false", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephx_require_version": "2", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephx_service_require_signatures": "false", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephx_service_require_version": "2", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "cephx_sign_messages": "true", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "chdir": "", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "client_acl_type": "", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "client_asio_thread_count": "2", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "client_cache_mid": "0.750000", 2024-04-25T09:27:57.195 INFO:teuthology.orchestra.run.smithi165.stdout: "client_cache_size": "16384", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_caps_release_delay": "5", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_check_pool_perm": "true", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_debug_force_sync_read": "false", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_debug_getattr_caps": "false", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_debug_inject_tick_delay": "0", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_die_on_failed_remount": "false", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_dirsize_rbytes": "true", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_force_lazyio": "false", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_fs": "", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_inject_release_failure": "false", 2024-04-25T09:27:57.196 INFO:teuthology.orchestra.run.smithi165.stdout: "client_max_inline_size": "4096", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_mds_namespace": "", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_metadata": "", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_mount_gid": "-1", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_mount_timeout": "300", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_mount_uid": "-1", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_mountpoint": "/", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_notify_timeout": "10", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_oc": "true", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_oc_max_dirty": "104857600", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_oc_max_objects": "1000", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_oc_size": "209715200", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_oc_target_dirty": "8388608", 2024-04-25T09:27:57.197 INFO:teuthology.orchestra.run.smithi165.stdout: "client_permissions": "true", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_quota": "true", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_quota_df": "true", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_readahead_max_bytes": "0", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_readahead_max_periods": "4", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_readahead_min": "131072", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_reconnect_stale": "false", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_shutdown_timeout": "30", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_snapdir": ".snap", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_tick_interval": "1", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_trace": "", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_try_dentry_invalidate": "false", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_use_faked_inos": "false", 2024-04-25T09:27:57.198 INFO:teuthology.orchestra.run.smithi165.stdout: "client_use_random_mds": "false", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "clog_to_graylog": "false", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "clog_to_graylog_port": "12201", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "clog_to_monitors": "default=true", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "clog_to_syslog": "false", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "clog_to_syslog_level": "info", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "cluster_addr": "-", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "cluster_network": "", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "cluster_network_interface": "", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "compressor_zlib_isal": "false", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "compressor_zlib_level": "5", 2024-04-25T09:27:57.199 INFO:teuthology.orchestra.run.smithi165.stdout: "compressor_zlib_winsize": "-15", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "compressor_zstd_level": "1", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crimson_alien_op_num_threads": "6", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crimson_osd_stat_interval": "0", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crimson_seastar_cpu_cores": "", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crush_location": "", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crush_location_hook": "", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "crush_location_hook_timeout": "10", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "daemonize": "false", 2024-04-25T09:27:57.200 INFO:teuthology.orchestra.run.smithi165.stdout: "daos_pool": "tank", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_alienstore": "0/5", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_allow_any_pool_priority": "false", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_asok": "1/5", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_asok_assert_abort": "false", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_asserts_on_shutdown": "true", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_auth": "20/20", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_bdev": "1/3", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_bluefs": "1/5", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_bluestore": "1/5", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_buffer": "0/1", 2024-04-25T09:27:57.201 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_ceph_exporter": "1/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_cephfs_mirror": "0/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_cephsqlite": "0/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_client": "0/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_compressor": "1/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_context": "0/1", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_crimson_interrupt": "0/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_crush": "1/1", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_crypto": "1/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_cyanstore": "0/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_deliberately_leak_memory": "false", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_disable_randomized_ping": "false", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_dpdk": "1/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_eventtrace": "1/5", 2024-04-25T09:27:57.202 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_filer": "0/1", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_filestore": "1/3", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_finisher": "1/1", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_fuse": "1/5", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_heartbeat_testing_span": "0", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_heartbeatmap": "1/5", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_javaclient": "1/5", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_journal": "1/3", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_journaler": "0/5", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_kstore": "1/5", 2024-04-25T09:27:57.203 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_lockdep": "0/1", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mclock": "1/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mds": "1/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mds_balancer": "1/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mds_locker": "1/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mds_log": "1/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mds_log_expire": "1/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mds_migrator": "1/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mds_quiesce": "3/5", 2024-04-25T09:27:57.204 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_memstore": "1/5", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mgr": "2/5", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mgrc": "1/5", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_mon": "20/20", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_monc": "0/10", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_ms": "1/1", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_none": "0/5", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_objclass": "0/5", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_objectcacher": "0/5", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_objecter": "0/1", 2024-04-25T09:27:57.205 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_optracker": "0/5", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_osd": "1/5", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_paxos": "20/20", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_perfcounter": "1/5", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_prioritycache": "1/5", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rados": "0/5", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rbd": "0/5", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rbd_mirror": "0/5", 2024-04-25T09:27:57.206 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rbd_pwl": "0/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rbd_replay": "0/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_refs": "0/0", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_reserver": "1/1", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw_access": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw_datacache": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw_dbstore": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw_flight": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw_notification": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rgw_sync": "1/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_rocksdb": "4/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore": "0/5", 2024-04-25T09:27:57.207 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_backref": "0/5", 2024-04-25T09:27:57.208 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_cache": "0/5", 2024-04-25T09:27:57.208 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_cleaner": "0/5", 2024-04-25T09:27:57.208 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_device": "0/5", 2024-04-25T09:27:57.208 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_epm": "0/5", 2024-04-25T09:27:57.208 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-25T09:27:57.210 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_journal": "0/5", 2024-04-25T09:27:57.210 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_lba": "0/5", 2024-04-25T09:27:57.210 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_odata": "0/5", 2024-04-25T09:27:57.210 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_omap": "0/5", 2024-04-25T09:27:57.210 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_onode": "0/5", 2024-04-25T09:27:57.210 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_t": "0/5", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_seastore_tm": "0/5", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_striper": "0/1", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_test": "0/5", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_throttle": "1/1", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_timer": "0/1", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_tp": "0/5", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "debug_trace": "1/5", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "device_failure_prediction_mode": "none", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-25T09:27:57.211 INFO:teuthology.orchestra.run.smithi165.stdout: "err_to_graylog": "false", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "err_to_journald": "false", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "err_to_stderr": "true", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "err_to_syslog": "false", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "event_tracing": "false", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "exporter_addr": "0.0.0.0", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "exporter_http_port": "9926", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "exporter_prio_limit": "5", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "exporter_sort_metrics": "true", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "exporter_stats_period": "5", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "fake_statfs_for_testing": "0", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "fatal_signal_handlers": "true", 2024-04-25T09:27:57.212 INFO:teuthology.orchestra.run.smithi165.stdout: "filer_max_purge_ops": "10", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filer_max_truncate_ops": "128", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_apply_finisher_threads": "1", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_blackhole": "false", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_btrfs_clone_range": "true", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_btrfs_snap": "true", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_caller_concurrency": "10", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_collect_device_partition_information": "true", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_commit_timeout": "600.000000", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_debug_inject_read_err": "false", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_debug_omap_check": "false", 2024-04-25T09:27:57.213 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_debug_verify_split": "false", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_dump_file": "", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_fadvise": "true", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_fail_eio": "true", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_fd_cache_shards": "16", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_fd_cache_size": "128", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_fiemap": "false", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_fiemap_threshold": "4096", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-25T09:27:57.214 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_inject_stall": "0", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_journal_parallel": "false", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_journal_trailing": "false", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_journal_writeahead": "false", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_kill_at": "0", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-25T09:27:57.215 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattrs": "0", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_xattr_value_size": "0", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-25T09:27:57.216 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_merge_threshold": "-10", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_odsync_write": "false", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_omap_backend": "rocksdb", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_omap_backend_path": "", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_op_thread_timeout": "60", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_op_threads": "2", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_punch_hole": "false", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-25T09:27:57.217 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_queue_max_ops": "50", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_seek_data_hole": "false", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_sloppy_crc": "false", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-25T09:27:57.218 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_splice": "false", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_split_multiple": "2", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_split_rand_factor": "20", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_update_to": "1000", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_enable": "true", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-25T09:27:57.219 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_xfs_extsize": "false", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "filestore_zfs_snap": "false", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fio_dir": "/tmp/fio", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fsid": "cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_allow_other": "true", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_atomic_o_trunc": "true", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_big_writes": "true", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_debug": "false", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_default_permissions": "false", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_disable_pagecache": "false", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_max_write": "0", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_multithreaded": "true", 2024-04-25T09:27:57.220 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_require_active_mds": "true", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_set_user_groups": "true", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_splice_move": "true", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_splice_read": "true", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_splice_write": "true", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "fuse_use_invalidate_cb": "true", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "gss_target_name": "ceph", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "heartbeat_file": "", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "heartbeat_inject_failure": "0", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "heartbeat_interval": "5", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "host": "smithi165", 2024-04-25T09:27:57.221 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-25T09:27:57.222 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "inject_early_sigterm": "false", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "jaeger_agent_port": "6799", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "jaeger_tracing_enable": "false", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_aio": "true", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_align_min_size": "65536", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_block_align": "true", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_block_size": "4096", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_dio": "true", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_discard": "false", 2024-04-25T09:27:57.223 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_force_aio": "false", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_ignore_corruption": "false", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_max_write_bytes": "10485760", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_max_write_entries": "100", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_replay_from": "0", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-25T09:27:57.224 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_write_header_frequency": "0", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "journal_zero_on_create": "false", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "journaler_prefetch_periods": "10", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "journaler_prezero_periods": "5", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "journaler_write_head_interval": "15", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "key": "", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "keyfile": "", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_backend": "rocksdb", 2024-04-25T09:27:57.225 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_default_stripe_size": "65536", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_fsck_on_mount": "false", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_max_bytes": "67108864", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_max_ops": "512", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_nid_prealloc": "1024", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_onode_map_size": "1024", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_sync_submit_transaction": "false", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "kstore_sync_transaction": "false", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "librados_thread_count": "2", 2024-04-25T09:27:57.226 INFO:teuthology.orchestra.run.smithi165.stdout: "lockdep": "false", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "lockdep_force_backtrace": "false", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_coarse_timestamps": "true", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_flush_on_exit": "false", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_graylog_host": "127.0.0.1", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_graylog_port": "12201", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_max_new": "1000", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_max_recent": "10000", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_stderr_prefix": "", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_stop_at_utilization": "0.970000", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_to_file": "true", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_to_graylog": "false", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_to_journald": "false", 2024-04-25T09:27:57.227 INFO:teuthology.orchestra.run.smithi165.stdout: "log_to_stderr": "false", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "log_to_syslog": "false", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "max_rotating_auth_attempts": "10", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_action_on_write_error": "1", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_alternate_name_max": "8192", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_asio_thread_count": "2", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_export_pin": "true", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_fragment_dirs": "true", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_fragment_interval": "5", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_interval": "10", 2024-04-25T09:27:57.228 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_max": "-1", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_max_until": "-1", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_merge_size": "50", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_midchunk": "0.300000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_min_start": "0.200000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_minchunk": "0.001000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_mode": "0", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_need_max": "1.200000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_need_min": "0.800000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_overload_epochs": "2", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_split_bits": "3", 2024-04-25T09:27:57.229 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_split_size": "10000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_target_decay": "10.000000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_beacon_grace": "15.000000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_beacon_interval": "4.000000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_mid": "0.700000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_quiesce_delay": "0", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-25T09:27:57.230 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_release_free_interval": "10", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_reservation": "0.050000", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_trim_interval": "1", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache_trim_threshold": "262144", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_client_prealloc_inos": "1000", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_connect_bootstrapping": "false", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_damage_table_max_entries": "10000", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-25T09:27:57.231 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_debug_auth_pins": "false", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_debug_frag": "false", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_debug_scatterstat": "false", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_debug_subtrees": "false", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_decay_halflife": "5.000000", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_default_dir_hash": "2", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_defer_session_stale": "true", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_deny_all_reconnect": "false", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dir_keys_per_op": "16384", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dir_max_commit_size": "10", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dir_max_entries": "0", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dir_prefetch": "true", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dump_cache_on_map": "false", 2024-04-25T09:27:57.232 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_early_reply": "true", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_enable_op_tracker": "true", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_enforce_unique_name": "true", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_export_ephemeral_random": "true", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-25T09:27:57.233 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_health_summarize_threshold": "10", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_inject_health_dummy": "false", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_inject_migrator_session_race": "false", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_join_fs": "", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_journal_format": "1", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_create_at": "0", 2024-04-25T09:27:57.234 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_export_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_import_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_journal_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_journal_expire_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_journal_replay_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_link_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_mdstable_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_openc_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_rename_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_shutdown_at": "0", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_event_large_threshold": "524288", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_events_per_segment": "1024", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_max_events": "-1", 2024-04-25T09:27:57.235 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_max_segments": "128", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_pause": "false", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_segment_size": "0", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_trim_threshold": "128", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log_warn_factor": "2.000000", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_caps_per_client": "1048576", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_completed_flushes": "100000", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_completed_requests": "100000", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_export_size": "20971520", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_file_recover": "32", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_purge_files": "64", 2024-04-25T09:27:57.236 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_purge_ops": "8192", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_max_snaps_per_dir": "100", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_metrics_update_interval": "2", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_min_caps_per_client": "100", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_min_caps_working_set": "10000", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_numa_node": "-1", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_op_complaint_time": "30.000000", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_op_history_duration": "600", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_op_history_size": "20", 2024-04-25T09:27:57.237 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_op_history_slow_op_size": "20", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_op_log_threshold": "5", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_ping_grace": "15", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_ping_interval": "5", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_recall_max_caps": "30000", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_recall_warning_threshold": "262144", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_replay_interval": "1.000000", 2024-04-25T09:27:57.238 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_root_ino_gid": "0", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_root_ino_uid": "0", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_shutdown_check": "0", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_skip_ino": "0", 2024-04-25T09:27:57.239 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_snap_max_uid": "4294967294", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_snap_min_uid": "0", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_snap_rstat": "false", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_standby_replay_damaged": "false", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_symlink_recovery": "true", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_thrash_exports": "0", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_thrash_fragments": "0", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_tick_interval": "5.000000", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_valgrind_exit": "false", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_verify_backtrace": "1", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_verify_scatter": "false", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-25T09:27:57.240 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_wipe_sessions": "false", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool_debug": "false", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "memstore_device_bytes": "1073741824", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "memstore_page_set": "false", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "memstore_page_size": "65536", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_client_bytes": "134217728", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_client_messages": "512", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_disabled_modules": "", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-25T09:27:57.241 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_max_pg_creating": "1024", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_max_pg_num_change": "128", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_mds_bytes": "134217728", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_mds_messages": "128", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_mon_bytes": "134217728", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_mon_messages": "128", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_osd_bytes": "536870912", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_osd_messages": "8192", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_pool": "true", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_standby_modules": "true", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_stats_period": "5", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_stats_threshold": "5", 2024-04-25T09:27:57.242 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_tick_period": "2", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_allow_pool_delete": "true", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_allow_pool_size_one": "true", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_auth_validate_all_caps": "true", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_bytes": "104857600", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_directed_command_retry": "2", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_hunt_parallel": "3", 2024-04-25T09:27:57.243 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_log_interval": "1.000000", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_ping_interval": "10.000000", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_client_target_rank": "-1", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_level": "debug", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_file": "true", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_journald": "false", 2024-04-25T09:27:57.244 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_compact_on_bootstrap": "false", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_compact_on_start": "false", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_compact_on_trim": "true", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_cpu_threads": "4", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_crush_min_required_version": "hammer", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_daemon_bytes": "419430400", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_data_avail_crit": "5", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_data_avail_warn": "5", 2024-04-25T09:27:57.245 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_data_size_warn": "16106127360", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_dump_json": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_dump_transactions": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_extra_checks": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_no_require_reef": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_no_require_squid": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-25T09:27:57.246 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_down_mkfs_grace": "120", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_down_uptime_grace": "60", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_election_default_strategy": "1", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_election_timeout": "5.000000", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_elector_ping_divisor": "2", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_enable_op_tracker": "true", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_fake_pool_delete": "false", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_force_quorum_join": "false", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_globalid_prealloc": "10000", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_health_detail_to_clog": "false", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_health_log_update_period": "5", 2024-04-25T09:27:57.247 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_health_max_detail": "50", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_health_to_clog": "true", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_health_to_clog_interval": "600", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_host": "172.21.15.165", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_host_override": "", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_initial_members": "", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_lease": "5.000000", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-25T09:27:57.248 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_log_full_interval": "50", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_log_max": "10000", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_log_max_summary": "50", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_log_epochs": "500", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_osd": "10000", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_pg_per_osd": "10000", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_pool_pg_num": "65536", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mds_force_trim_to": "0", 2024-04-25T09:27:57.249 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mds_skip_sanity": "false", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_memory_autotune": "true", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_memory_target": "2147483648", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mgr_beacon_grace": "30", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mgr_digest_period": "5", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mgr_inactive_grace": "60", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_min_osdmap_epochs": "50", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_op_complaint_time": "30", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_op_history_duration": "600", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_op_history_size": "20", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_op_history_slow_op_size": "20", 2024-04-25T09:27:57.250 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_op_log_threshold": "5", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_auto_mark_in": "false", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_cache_size": "500", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-25T09:27:57.251 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_down_out_interval": "600", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_force_trim_to": "0", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_min_down_reporters": "2", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-25T09:27:57.252 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_report_timeout": "900", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osdmap_full_prune_interval": "2", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osdmap_full_prune_min": "15", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pg_stuck_threshold": "60", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-25T09:27:57.253 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_probe_timeout": "2.000000", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_reweight_max_change": "0.050000", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_reweight_max_osds": "4", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_scrub_interval": "86400", 2024-04-25T09:27:57.254 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_scrub_max_keys": "100", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_scrub_timeout": "300", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_session_timeout": "300", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_smart_report_timeout": "5", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_stat_smooth_intervals": "6", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_stretch_pool_min_size": "2", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_stretch_pool_size": "4", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_sync_debug": "false", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-25T09:27:57.255 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_sync_provider_kill_at": "0", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_sync_requester_kill_at": "0", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_sync_timeout": "60.000000", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_target_pg_per_osd": "100", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_tick_interval": "5", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_timecheck_interval": "300.000000", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_use_min_delay_socket": "false", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_older_version_delay": "604800", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-25T09:27:57.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_misplaced": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_older_version": "true", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-25T09:27:57.257 INFO:teuthology.orchestra.run.smithi165.stdout: "monmap": "", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "motr_tracing_enabled": "false", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_op_threads": "3", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_cm": "false", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_device_name": "", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_dscp": "96", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-25T09:27:57.258 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_local_gid": "", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_port_num": "1", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_sl": "3", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_support_srq": "true", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_rdma_type": "ib", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_async_reap_threshold": "5", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_before_connect": "false", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_ipv4": "true", 2024-04-25T09:27:57.259 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_ipv6": "false", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_msgr1": "true", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_msgr2": "true", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_port_max": "7568", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_port_min": "6800", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_retry_count": "3", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_bind_retry_delay": "5", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_blackhole_client": "false", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_blackhole_mds": "false", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_blackhole_mgr": "false", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_blackhole_mon": "false", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_blackhole_osd": "false", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_client_mode": "crc", 2024-04-25T09:27:57.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_cluster_mode": "crc", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_cluster_type": "", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_compress_secure": "false", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_connection_idle_timeout": "900", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_connection_ready_timeout": "10", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_crc_data": "true", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_crc_header": "true", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_die_on_bad_msg": "false", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_die_on_bug": "true", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_die_on_old_message": "true", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_die_on_skipped_message": "false", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-25T09:27:57.261 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_coremask": "0xF", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_enable_tso": "true", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_hugepages": "", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_lro": "true", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_memory_channel": "4", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_pmd": "", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_port_id": "0", 2024-04-25T09:27:57.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_dump_on_send": "false", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_initial_backoff": "0.200000", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_inject_delay_max": "1.000000", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_inject_delay_type": "", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_inject_network_congestion": "0", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_inject_socket_failures": "0", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_learn_addr_from_peer": "true", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_max_accept_failures": "4", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_max_backoff": "15.000000", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_mon_client_mode": "crc", 2024-04-25T09:27:57.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_mon_cluster_mode": "crc", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_mon_service_mode": "crc", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_osd_compress_min_size": "1024", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_osd_compress_mode": "none", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_pq_min_cost": "65536", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_public_type": "", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_service_mode": "crc", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_tcp_listen_backlog": "512", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_tcp_nodelay": "true", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_tcp_rcvbuf": "0", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ms_type": "async+posix", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "no_config_file": "false", 2024-04-25T09:27:57.264 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_completion_locks_per_session": "32", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_inflight_ops": "1024", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_tick_interval": "5.000000", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter_timeout": "10.000000", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objectstore_blackhole": "false", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "openssl_engine_opts": "", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_agent_delay_time": "5.000000", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_agent_hist_halflife": "1000", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_agent_max_low_ops": "2", 2024-04-25T09:27:57.265 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_agent_max_ops": "4", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_agent_slop": "0.020000", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_asio_thread_count": "2", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_async_recovery_min_cost": "100", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_backfill_scan_max": "512", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_backfill_scan_min": "64", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_backoff_on_degraded": "false", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_backoff_on_peering": "false", 2024-04-25T09:27:57.266 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_backoff_on_unfound": "true", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_beacon_report_interval": "300", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bench_duration": "30", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bench_max_block_size": "67108864", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_blkin_trace_all": "false", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_check_for_log_corruption": "false", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T09:27:57.267 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_class_update_on_start": "true", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_client_message_cap": "256", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_client_message_size_cap": "524288000", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_client_op_priority": "63", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_client_watch_timeout": "30", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_command_max_records": "256", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_compact_on_start": "false", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_crush_update_on_start": "true", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_crush_update_weight_set": "true", 2024-04-25T09:27:57.268 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_feed_pullee": "-1", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_misdirected_ops": "false", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_no_acting_change": "false", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_no_purge_strays": "false", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_op_order": "false", 2024-04-25T09:27:57.269 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_shutdown": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_trim_objects": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_verify_snaps": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-25T09:27:57.270 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_deep_scrub_keys": "1024", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_deep_scrub_stride": "524288", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_default_notify_timeout": "30", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_delete_sleep": "0.000000", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_discard_disconnected_ops": "true", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_enable_op_tracker": "true", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-25T09:27:57.271 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_fast_info": "true", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_fast_shutdown": "true", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_function_tracing": "false", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_heartbeat_grace": "20", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_heartbeat_interval": "6", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-25T09:27:57.272 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_heartbeat_min_peers": "10", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_heartbeat_min_size": "2000", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_heartbeat_stale": "600", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_hit_set_max_size": "100000", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_hit_set_min_size": "1000", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_journal_size": "5120", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_kill_backfill_at": "0", 2024-04-25T09:27:57.273 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_map_cache_size": "50", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_map_dedup": "true", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_map_message_max": "40", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_map_share_max_epochs": "40", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_attr_name_len": "100", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_attr_size": "0", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_backfills": "1", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_markdown_count": "5", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_markdown_period": "600", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_object_name_len": "2048", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_object_namespace_len": "256", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_object_size": "134217728", 2024-04-25T09:27:57.274 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_pg_blocked_by": "16", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_pg_log_entries": "10000", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_pgls": "1024", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_push_cost": "8388608", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_push_objects": "10", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_scrubs": "3", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_trimming_pgs": "2", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_write_op_reply_len": "64", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_max_write_size": "90", 2024-04-25T09:27:57.275 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_profile": "balanced", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-25T09:27:57.276 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_memory_base": "805306368", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_memory_cache_min": "134217728", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_memory_target": "4294967296", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_memory_target_autotune": "false", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_min_pg_log_entries": "250", 2024-04-25T09:27:57.277 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_min_recovery_priority": "0", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mon_report_interval": "5", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_num_cache_shards": "32", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_num_op_tracker_shard": "32", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_numa_auto_affinity": "true", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_numa_node": "-1", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_numa_prefer_iface": "true", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_objecter_finishers": "1", 2024-04-25T09:27:57.278 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_objectstore": "bluestore", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_objectstore_fuse": "false", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_objectstore_tracing": "false", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_complaint_time": "30.000000", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_history_duration": "600", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_history_size": "20", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_history_slow_op_size": "20", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_log_threshold": "5", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_num_shards": "0", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_num_shards_hdd": "5", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_num_shards_ssd": "8", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-25T09:27:57.279 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_pq_min_cost": "65536", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_queue_cut_off": "high", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_op_thread_timeout": "15", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_open_classes_on_start": "true", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_os_flags": "0", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_peering_op_priority": "255", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_delete_cost": "1048576", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_delete_priority": "5", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-25T09:27:57.280 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_log_trim_max": "10000", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_log_trim_min": "100", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_crimson": "true", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-25T09:27:57.281 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_flags": "0", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_min_size": "2", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_pg_num": "32", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_pgp_num": "0", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-25T09:27:57.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_read_ratio": "70", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_size": "3", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_default_type": "replicated", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_push_per_object_cost": "1000", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recover_clone_overlap": "true", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_cost": "20971520", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_max_active": "0", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-25T09:27:57.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_max_single_start": "1", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_op_priority": "3", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_priority": "5", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_sleep": "0.000000", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_repair_during_recovery": "false", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_requested_scrub_priority": "120", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-25T09:27:57.284 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_auto_repair": "false", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_begin_hour": "0", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_begin_week_day": "0", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_chunk_max": "25", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_chunk_min": "5", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_cost": "52428800", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_during_recovery": "false", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_end_hour": "0", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_end_week_day": "0", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_event_cost": "4096", 2024-04-25T09:27:57.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_invalid_stats": "true", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_max_preemptions": "5", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_priority": "5", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_scrub_sleep": "0.000000", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-25T09:27:57.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_skip_data_digest": "false", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_smart_report_timeout": "5", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_snap_trim_cost": "1048576", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_snap_trim_priority": "5", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_target_transaction_size": "30", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-25T09:27:57.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_tracing": "false", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_use_stale_snap": "false", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osdc_blkin_trace_all": "false", 2024-04-25T09:27:57.288 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_kill_at": "0", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_max_join_drift": "10", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_min": "500", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_min_wait": "0.050000", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_propose_interval": "1.000000", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_service_trim_max": "500", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_service_trim_min": "10", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_stash_full_interval": "25", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_trim_max": "500", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "paxos_trim_min": "250", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "perf": "true", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-25T09:27:57.289 INFO:teuthology.orchestra.run.smithi165.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "public_addr": "-", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "public_addrv": "", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "public_bind_addr": "-", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "public_network": "", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "public_network_interface": "", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "qat_compressor_enabled": "false", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "qat_compressor_session_max_number": "256", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "rados_mon_op_timeout": "0", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "rados_osd_op_timeout": "0", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "rados_tracing": "false", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_atime_update_interval": "60", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_balance_parent_reads": "false", 2024-04-25T09:27:57.290 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_balance_snap_reads": "false", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_blkin_trace_all": "false", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache": "true", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_policy": "writearound", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_size": "33554432", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_clone_copy_on_read": "false", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_compression_hint": "none", 2024-04-25T09:27:57.291 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_concurrent_management_ops": "10", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_clone_format": "auto", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_data_pool": "", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_features": "61", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_format": "2", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_map_options": "", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_order": "22", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_pool": "rbd", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_stripe_count": "0", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_default_stripe_unit": "0", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-25T09:27:57.292 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_enable_alloc_hint": "true", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_io_scheduler": "simple", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-25T09:27:57.293 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_order": "24", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_pool": "", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_journal_splay_width": "4", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_localize_parent_reads": "false", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_localize_snap_reads": "false", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-25T09:27:57.294 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-25T09:27:57.295 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_mtime_update_interval": "60", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_non_blocking_aio": "true", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_op_thread_timeout": "60", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_op_threads": "1", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_parent_cache_enabled": "false", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-25T09:27:57.296 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_plugins": "", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_bps_burst": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_bps_limit": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_exclude_ops": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_iops_burst": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_iops_limit": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-25T09:27:57.297 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_read_from_replica_policy": "default", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-25T09:27:57.298 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_skip_partial_discard": "true", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_tracing": "false", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_validate_names": "true", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rbd_validate_pool": "true", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "restapi_base_url": "", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "restapi_log_level": "", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_acl_grants_max_num": "100", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_admin_entry": "admin", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_backend_store": "rados", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_barbican_url": "", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_beast_enable_async": "true", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_counters_cache": "false", 2024-04-25T09:27:57.299 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_cache_enabled": "true", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_cache_expiry_interval": "900", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_cache_lru_size": "10000", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_config_store": "rados", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_content_length_compat": "false", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_copy_obj_progress": "true", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-25T09:27:57.300 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_cors_rules_max_num": "100", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_cross_domain_policy": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_addr": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_password": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_kmip_username": "", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_require_ssl": "true", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-25T09:27:57.301 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-25T09:27:57.302 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_addr": "", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_auth": "token", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_namespace": "", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_prefix": "", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_token_file": "", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_curl_buffersize": "524288", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_curl_low_speed_time": "300", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-25T09:27:57.303 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-25T09:27:57.304 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_d4n_port": "6379", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data_log_changes_size": "1000", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data_log_num_shards": "128", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data_log_window": "30", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-25T09:27:57.305 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-25T09:27:57.306 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dns_name": "", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dns_s3website_name": "", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_dynamic_resharding": "true", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enable_gc_threads": "true", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enable_lc_threads": "true", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enable_ops_log": "false", 2024-04-25T09:27:57.307 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enable_quota_threads": "true", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enable_static_website": "false", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enable_usage_log": "false", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_enforce_swift_acls": "true", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_exit_timeout_secs": "120", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_expose_bucket": "false", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_extended_http_attrs": "", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_filter": "none", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_frontends": "beast port=7480", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_max_deferred": "50", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_max_objs": "32", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-25T09:27:57.308 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_gc_processor_period": "3600", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_init_timeout": "300", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_kafka_connection_idle": "300", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-25T09:27:57.309 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_domain": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_password": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_password_path": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_project": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_tenant": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_token": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_token_path": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_admin_user": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_api_version": "2", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_barbican_domain": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_barbican_password": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_barbican_project": "", 2024-04-25T09:27:57.310 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_barbican_user": "", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_url": "", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lc_debug_interval": "-1", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lc_lock_max_time": "90", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lc_max_objs": "32", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lc_max_rules": "1000", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lc_max_worker": "3", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-25T09:27:57.311 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lc_thread_delay": "0", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ldap_dnattr": "uid", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ldap_searchfilter": "", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ldap_uri": "", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_log_http_headers": "", 2024-04-25T09:27:57.312 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_log_object_name_utc": "false", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_attr_name_len": "0", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_attr_size": "0", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_chunk_size": "4194304", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_listing_results": "1000", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_notify_retries": "10", 2024-04-25T09:27:57.313 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_put_param_size": "1048576", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_put_size": "5368709120", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_max_slo_entries": "1000", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_md_log_max_shards": "64", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_mp_lock_max_time": "600", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-25T09:27:57.314 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_max_gc": "300", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_num_async_rados_threads": "32", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_num_control_oids": "8", 2024-04-25T09:27:57.315 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_numa_node": "-1", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_objexp_chunk_size": "100", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_objexp_gc_interval": "600", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_op_thread_timeout": "600", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_op_tracing": "false", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_opa_token": "", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_opa_url": "", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_opa_verify_ssl": "true", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-25T09:27:57.316 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ops_log_rados": "false", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_ops_log_socket_path": "", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_period_push_interval": "2.000000", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_posix_cache_lanes": "3", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-25T09:27:57.317 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_posix_cache_partitions": "3", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_print_continue": "true", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_rados_tracing": "false", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_realm": "", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_realm_id": "", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-25T09:27:57.318 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_region": "", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_request_uri": "", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_reshard_batch_size": "64", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_reshard_max_aio": "128", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_reshard_num_logs": "16", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_reshard_thread_interval": "600", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_resolve_cname": "false", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_run_sync_thread": "true", 2024-04-25T09:27:57.319 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_scheduler_type": "throttler", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_script_uri": "", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_service_provider_name": "", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sts_client_id": "", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sts_client_secret": "", 2024-04-25T09:27:57.320 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sts_entry": "sts", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sts_key": "sts", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sts_min_session_duration": "900", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sts_token_introspection_url": "", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_account_in_url": "false", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_auth_entry": "auth", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_auth_url": "", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_custom_header": "", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_need_stats": "true", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_tenant_name": "", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_token_expiration": "86400", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_url": "", 2024-04-25T09:27:57.321 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_url_prefix": "swift", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_lease_period": "120", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-25T09:27:57.322 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_thread_pool_size": "512", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_comment": "", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_createby": "", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_encoding": "", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_flag": "false", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_origin": "", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_torrent_tracker": "", 2024-04-25T09:27:57.323 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_trust_forwarded_https": "false", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_usage_max_shards": "32", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_usage_max_user_shards": "1", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_use_opa_authz": "false", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_counters_cache": "false", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_max_buckets": "1000", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_policies_max_num": "100", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-25T09:27:57.324 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_user_unique_email": "true", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_verify_ssl": "true", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_zone": "", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_zone_id": "", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_zonegroup": "", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_zonegroup_id": "", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgwlc_auto_session_clear": "true", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-25T09:27:57.325 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_block_size": "4096", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cache_size": "536870912", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-25T09:27:57.326 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_index_type": "binary_search", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_partition_filters": "false", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_perf": "false", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "run_dir": "/var/run/ceph", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_block_create": "true", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_cache_lru_size": "67108864", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-25T09:27:57.327 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_default_max_object_size": "16777216", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_device_size": "53687091200", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_journal_batch_capacity": "16", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_main_device_type": "SSD", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-25T09:27:57.328 INFO:teuthology.orchestra.run.smithi165.stdout: "seastore_segment_size": "67108864", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "set_keepcaps": "false", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "setgroup": "", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "setuser": "", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "setuser_match_path": "", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "thp": "false", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "threadpool_default_timeout": "60", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout: "throttler_perf_counter": "true" 2024-04-25T09:27:57.329 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T09:27:57.331 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-25T09:27:57.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.450+0000 7f471f2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.455+0000 7f471f2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.454 INFO:teuthology.orchestra.run.smithi165.stdout:{} 2024-04-25T09:27:57.455 INFO:teuthology.orchestra.run.smithi165.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T09:27:57.465 DEBUG:teuthology.orchestra.run.smithi165:> type ceph-objectstore-tool 2024-04-25T09:27:57.479 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-25T09:27:57.480 DEBUG:teuthology.orchestra.run.smithi172:> type ceph-objectstore-tool 2024-04-25T09:27:57.496 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-25T09:27:57.497 INFO:teuthology.run_tasks:Running task full_sequential... 2024-04-25T09:27:57.506 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:27:57.507 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:27:57.507 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-25T09:27:57.508 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-25T09:27:57.508 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-25T09:27:57.508 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:27:57.508 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:27:57.508 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-25T09:27:57.509 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:27:57.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.643+0000 7f91ad620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.648+0000 7f91ad620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.643+0000 7f8c9b99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.643+0000 7fbc32064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.655+0000 7f8c9b99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:57.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:57.655+0000 7fbc32064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:58.800 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_0' created 2024-04-25T09:27:58.800 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:27:58.824 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-25T09:27:58.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:27:58.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:59.002+0000 7f9803f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:58.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:59.012+0000 7f9803f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:58.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:59.004+0000 7f8a608ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:59.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:59.023+0000 7f8a608ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:59.765 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:27:59.805 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-25T09:27:59.806 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:27:59.828 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:27:59.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:59.931+0000 7f16b575d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:27:59.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:27:59.951+0000 7f16b575d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:00.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:00.057+0000 7f713a39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:00.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:00.074+0000 7f713a39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:00.814 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:28:00.824 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-04-25T09:28:00.826 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:28:00.827 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:28:00.830 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:28:00.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:28:00.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:28:00.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_29374 2024-04-25T09:28:00.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:28:00.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:28:01.010 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:01.018+0000 7f5055d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:01.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:01.030+0000 7f5055d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:01.820 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:28:01.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:28:01.841 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:01.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 156 140 1.09369 1.09375 0.0481449 0.107813 2024-04-25T09:28:02.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.024+0000 7f25eb4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:02.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.035+0000 7f25eb4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:02.182 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:02.270 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:02.271 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:02.294 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T09:28:01.839141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":975392,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":184,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108424,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377378936,"statfs":{"total":386547056640,"available":386436030464,"internally_reserved":0,"allocated":1142784,"data_stored":2726180,"data_compressed":131147,"data_compressed_allocated":524288,"data_compressed_original":2523136,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":385024,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.613402"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.945581+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:00.945581+0000","last_peered":"2024-04-25T09:28:00.945581+0000","last_clean":"2024-04-25T09:28:00.945581+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:00.945581+0000","last_undegraded":"2024-04-25T09:28:00.945581+0000","last_fullsized":"2024-04-25T09:28:00.945581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'15","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.361749+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:01.361749+0000","last_peered":"2024-04-25T09:28:01.361749+0000","last_clean":"2024-04-25T09:28:01.361749+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:01.361749+0000","last_undegraded":"2024-04-25T09:28:01.361749+0000","last_fullsized":"2024-04-25T09:28:01.361749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.043347+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:01.043347+0000","last_peered":"2024-04-25T09:28:01.043347+0000","last_clean":"2024-04-25T09:28:01.043347+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:01.043347+0000","last_undegraded":"2024-04-25T09:28:01.043347+0000","last_fullsized":"2024-04-25T09:28:01.043347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.231310+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:01.231310+0000","last_peered":"2024-04-25T09:28:01.231310+0000","last_clean":"2024-04-25T09:28:01.231310+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:01.231310+0000","last_undegraded":"2024-04-25T09:28:01.231310+0000","last_fullsized":"2024-04-25T09:28:01.231310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.140371+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:01.140371+0000","last_peered":"2024-04-25T09:28:01.140371+0000","last_clean":"2024-04-25T09:28:01.140371+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:01.140371+0000","last_undegraded":"2024-04-25T09:28:01.140371+0000","last_fullsized":"2024-04-25T09:28:01.140371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.379069+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:01.379069+0000","last_peered":"2024-04-25T09:28:01.379069+0000","last_clean":"2024-04-25T09:28:01.379069+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:01.379069+0000","last_undegraded":"2024-04-25T09:28:01.379069+0000","last_fullsized":"2024-04-25T09:28:01.379069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":145,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:52.467065+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:27:52.467065+0000","last_peered":"2024-04-25T09:27:52.467065+0000","last_clean":"2024-04-25T09:27:52.467065+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:27:52.467065+0000","last_undegraded":"2024-04-25T09:27:52.467065+0000","last_fullsized":"2024-04-25T09:27:52.467065+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.856755+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:00.856755+0000","last_peered":"2024-04-25T09:28:00.856755+0000","last_clean":"2024-04-25T09:28:00.856755+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:00.856755+0000","last_undegraded":"2024-04-25T09:28:00.856755+0000","last_fullsized":"2024-04-25T09:28:00.856755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858891+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:00.858891+0000","last_peered":"2024-04-25T09:28:00.858891+0000","last_clean":"2024-04-25T09:28:00.858891+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:00.858891+0000","last_undegraded":"2024-04-25T09:28:00.858891+0000","last_fullsized":"2024-04-25T09:28:00.858891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943694+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:00.943694+0000","last_peered":"2024-04-25T09:28:00.943694+0000","last_clean":"2024-04-25T09:28:00.943694+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:00.943694+0000","last_undegraded":"2024-04-25T09:28:00.943694+0000","last_fullsized":"2024-04-25T09:28:00.943694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.848353+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:00.848353+0000","last_peered":"2024-04-25T09:28:00.848353+0000","last_clean":"2024-04-25T09:28:00.848353+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:00.848353+0000","last_undegraded":"2024-04-25T09:28:00.848353+0000","last_fullsized":"2024-04-25T09:28:00.848353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943055+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:00.943055+0000","last_peered":"2024-04-25T09:28:00.943055+0000","last_clean":"2024-04-25T09:28:00.943055+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:00.943055+0000","last_undegraded":"2024-04-25T09:28:00.943055+0000","last_fullsized":"2024-04-25T09:28:00.943055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858677+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:00.858677+0000","last_peered":"2024-04-25T09:28:00.858677+0000","last_clean":"2024-04-25T09:28:00.858677+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:00.858677+0000","last_undegraded":"2024-04-25T09:28:00.858677+0000","last_fullsized":"2024-04-25T09:28:00.858677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488360+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:27:47.488360+0000","last_peered":"2024-04-25T09:27:47.488360+0000","last_clean":"2024-04-25T09:27:47.488360+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:27:47.488360+0000","last_undegraded":"2024-04-25T09:27:47.488360+0000","last_fullsized":"2024-04-25T09:27:47.488360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:52.471693+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:27:52.471693+0000","last_peered":"2024-04-25T09:27:52.471693+0000","last_clean":"2024-04-25T09:27:52.471693+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:27:52.471693+0000","last_undegraded":"2024-04-25T09:27:52.471693+0000","last_fullsized":"2024-04-25T09:27:52.471693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488040+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:27:47.488040+0000","last_peered":"2024-04-25T09:27:47.488040+0000","last_clean":"2024-04-25T09:27:47.488040+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:27:47.488040+0000","last_undegraded":"2024-04-25T09:27:47.488040+0000","last_fullsized":"2024-04-25T09:27:47.488040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.857718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:00.857718+0000","last_peered":"2024-04-25T09:28:00.857718+0000","last_clean":"2024-04-25T09:28:00.857718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:00.857718+0000","last_undegraded":"2024-04-25T09:28:00.857718+0000","last_fullsized":"2024-04-25T09:28:00.857718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":385024,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":819200,"data_compressed":42088,"data_compressed_allocated":409600,"data_compressed_original":819200,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27008,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344832,"statfs":{"total":96636764160,"available":96609107968,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27156,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":339968,"data_stored":420290,"data_compressed":19364,"data_compressed_allocated":188416,"data_compressed_original":376832,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":425984,"data_stored":1059810,"data_compressed":51849,"data_compressed_allocated":253952,"data_compressed_original":999424,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":425984,"data_compressed":21882,"data_compressed_allocated":212992,"data_compressed_original":425984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":393216,"data_compressed":20206,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:02.296 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:02.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.343+0000 7f851c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:02.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.350+0000 7f851c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:02.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.442+0000 7fee5922d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:02.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.453+0000 7fee5922d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:02.723 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:02.724 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:02.741 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T09:28:01.839141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":975392,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":184,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":51,"acting":51,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108424,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377378936,"statfs":{"total":386547056640,"available":386436030464,"internally_reserved":0,"allocated":1142784,"data_stored":2726180,"data_compressed":131147,"data_compressed_allocated":524288,"data_compressed_original":2523136,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":385024,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.613402"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.945581+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:00.945581+0000","last_peered":"2024-04-25T09:28:00.945581+0000","last_clean":"2024-04-25T09:28:00.945581+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:00.945581+0000","last_undegraded":"2024-04-25T09:28:00.945581+0000","last_fullsized":"2024-04-25T09:28:00.945581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"18'15","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.361749+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:01.361749+0000","last_peered":"2024-04-25T09:28:01.361749+0000","last_clean":"2024-04-25T09:28:01.361749+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:01.361749+0000","last_undegraded":"2024-04-25T09:28:01.361749+0000","last_fullsized":"2024-04-25T09:28:01.361749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.043347+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:01.043347+0000","last_peered":"2024-04-25T09:28:01.043347+0000","last_clean":"2024-04-25T09:28:01.043347+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:01.043347+0000","last_undegraded":"2024-04-25T09:28:01.043347+0000","last_fullsized":"2024-04-25T09:28:01.043347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.231310+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:01.231310+0000","last_peered":"2024-04-25T09:28:01.231310+0000","last_clean":"2024-04-25T09:28:01.231310+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:01.231310+0000","last_undegraded":"2024-04-25T09:28:01.231310+0000","last_fullsized":"2024-04-25T09:28:01.231310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.140371+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:01.140371+0000","last_peered":"2024-04-25T09:28:01.140371+0000","last_clean":"2024-04-25T09:28:01.140371+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:01.140371+0000","last_undegraded":"2024-04-25T09:28:01.140371+0000","last_fullsized":"2024-04-25T09:28:01.140371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.379069+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:01.379069+0000","last_peered":"2024-04-25T09:28:01.379069+0000","last_clean":"2024-04-25T09:28:01.379069+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:01.379069+0000","last_undegraded":"2024-04-25T09:28:01.379069+0000","last_fullsized":"2024-04-25T09:28:01.379069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":145,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:52.467065+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:27:52.467065+0000","last_peered":"2024-04-25T09:27:52.467065+0000","last_clean":"2024-04-25T09:27:52.467065+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:27:52.467065+0000","last_undegraded":"2024-04-25T09:27:52.467065+0000","last_fullsized":"2024-04-25T09:27:52.467065+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.856755+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:00.856755+0000","last_peered":"2024-04-25T09:28:00.856755+0000","last_clean":"2024-04-25T09:28:00.856755+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:00.856755+0000","last_undegraded":"2024-04-25T09:28:00.856755+0000","last_fullsized":"2024-04-25T09:28:00.856755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858891+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:00.858891+0000","last_peered":"2024-04-25T09:28:00.858891+0000","last_clean":"2024-04-25T09:28:00.858891+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:00.858891+0000","last_undegraded":"2024-04-25T09:28:00.858891+0000","last_fullsized":"2024-04-25T09:28:00.858891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943694+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:00.943694+0000","last_peered":"2024-04-25T09:28:00.943694+0000","last_clean":"2024-04-25T09:28:00.943694+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:00.943694+0000","last_undegraded":"2024-04-25T09:28:00.943694+0000","last_fullsized":"2024-04-25T09:28:00.943694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.848353+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:00.848353+0000","last_peered":"2024-04-25T09:28:00.848353+0000","last_clean":"2024-04-25T09:28:00.848353+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:00.848353+0000","last_undegraded":"2024-04-25T09:28:00.848353+0000","last_fullsized":"2024-04-25T09:28:00.848353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943055+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:00.943055+0000","last_peered":"2024-04-25T09:28:00.943055+0000","last_clean":"2024-04-25T09:28:00.943055+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:00.943055+0000","last_undegraded":"2024-04-25T09:28:00.943055+0000","last_fullsized":"2024-04-25T09:28:00.943055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858677+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:00.858677+0000","last_peered":"2024-04-25T09:28:00.858677+0000","last_clean":"2024-04-25T09:28:00.858677+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:00.858677+0000","last_undegraded":"2024-04-25T09:28:00.858677+0000","last_fullsized":"2024-04-25T09:28:00.858677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488360+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:27:47.488360+0000","last_peered":"2024-04-25T09:27:47.488360+0000","last_clean":"2024-04-25T09:27:47.488360+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:27:47.488360+0000","last_undegraded":"2024-04-25T09:27:47.488360+0000","last_fullsized":"2024-04-25T09:27:47.488360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:52.471693+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:27:52.471693+0000","last_peered":"2024-04-25T09:27:52.471693+0000","last_clean":"2024-04-25T09:27:52.471693+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:27:52.471693+0000","last_undegraded":"2024-04-25T09:27:52.471693+0000","last_fullsized":"2024-04-25T09:27:52.471693+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T09:27:47.488040+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:27:47.488040+0000","last_peered":"2024-04-25T09:27:47.488040+0000","last_clean":"2024-04-25T09:27:47.488040+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:27:47.488040+0000","last_undegraded":"2024-04-25T09:27:47.488040+0000","last_fullsized":"2024-04-25T09:27:47.488040+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:27:58.806760+0000","last_change":"2024-04-25T09:27:58.806760+0000","last_active":"2024-04-25T09:27:58.806760+0000","last_peered":"2024-04-25T09:27:58.806760+0000","last_clean":"2024-04-25T09:27:58.806760+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:27:58.806760+0000","last_undegraded":"2024-04-25T09:27:58.806760+0000","last_fullsized":"2024-04-25T09:27:58.806760+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.857718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:00.857718+0000","last_peered":"2024-04-25T09:28:00.857718+0000","last_clean":"2024-04-25T09:28:00.857718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:00.857718+0000","last_undegraded":"2024-04-25T09:28:00.857718+0000","last_fullsized":"2024-04-25T09:28:00.857718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":385024,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":819200,"data_compressed":42088,"data_compressed_allocated":409600,"data_compressed_original":819200,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":24,"acting":24,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27008,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344832,"statfs":{"total":96636764160,"available":96609107968,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":188416,"data_stored":623040,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27156,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":339968,"data_stored":420290,"data_compressed":19364,"data_compressed_allocated":188416,"data_compressed_original":376832,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":425984,"data_stored":1059810,"data_compressed":51849,"data_compressed_allocated":253952,"data_compressed_original":999424,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":425984,"data_compressed":21882,"data_compressed_allocated":212992,"data_compressed_original":425984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":393216,"data_compressed":20206,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:02.742 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:28:02.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 309 293 1.14445 1.19531 0.026307 0.105809 2024-04-25T09:28:02.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.901+0000 7f3f6819d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:02.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:02.911+0000 7f3f6819d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:03.299 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:03.299 INFO:teuthology.orchestra.run.smithi165.stdout:{"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":19,"num_osds":4,"num_up_osds":4,"osd_up_since":1714037262,"num_in_osds":4,"osd_in_since":1714037256,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":110575616,"bytes_avail":386436481024,"bytes_total":386547056640,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-25T09:27:34.288648+0000","services":{}},"progress_events":{}} 2024-04-25T09:28:03.323 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-25T09:28:03.323 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:03.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:03.484+0000 7f05b959d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:03.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:03.494+0000 7f05b959d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:03.782 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:03.782 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:03.801 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T09:28:03.226993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1958432,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":304,"num_write_kb":3230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":252,"ondisk_log_size":252,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":109964,"kb_used_data":2668,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377377396,"statfs":{"total":386547056640,"available":386434453504,"internally_reserved":0,"allocated":2732032,"data_stored":5814805,"data_compressed":288797,"data_compressed_allocated":2056192,"data_compressed_original":5586944,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1368064,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":1336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.408385"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.945581+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:00.945581+0000","last_peered":"2024-04-25T09:28:00.945581+0000","last_clean":"2024-04-25T09:28:00.945581+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:00.945581+0000","last_undegraded":"2024-04-25T09:28:00.945581+0000","last_fullsized":"2024-04-25T09:28:00.945581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'31","reported_seq":47,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.159919+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:02.159919+0000","last_peered":"2024-04-25T09:28:02.159919+0000","last_clean":"2024-04-25T09:28:02.159919+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:02.159919+0000","last_undegraded":"2024-04-25T09:28:02.159919+0000","last_fullsized":"2024-04-25T09:28:02.159919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'15","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.361749+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:01.361749+0000","last_peered":"2024-04-25T09:28:01.361749+0000","last_clean":"2024-04-25T09:28:01.361749+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:01.361749+0000","last_undegraded":"2024-04-25T09:28:01.361749+0000","last_fullsized":"2024-04-25T09:28:01.361749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.043347+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:01.043347+0000","last_peered":"2024-04-25T09:28:01.043347+0000","last_clean":"2024-04-25T09:28:01.043347+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:01.043347+0000","last_undegraded":"2024-04-25T09:28:01.043347+0000","last_fullsized":"2024-04-25T09:28:01.043347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'15","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.143054+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:02.143054+0000","last_peered":"2024-04-25T09:28:02.143054+0000","last_clean":"2024-04-25T09:28:02.143054+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:02.143054+0000","last_undegraded":"2024-04-25T09:28:02.143054+0000","last_fullsized":"2024-04-25T09:28:02.143054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.231310+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:01.231310+0000","last_peered":"2024-04-25T09:28:01.231310+0000","last_clean":"2024-04-25T09:28:01.231310+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:01.231310+0000","last_undegraded":"2024-04-25T09:28:01.231310+0000","last_fullsized":"2024-04-25T09:28:01.231310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.140371+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:01.140371+0000","last_peered":"2024-04-25T09:28:01.140371+0000","last_clean":"2024-04-25T09:28:01.140371+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:01.140371+0000","last_undegraded":"2024-04-25T09:28:01.140371+0000","last_fullsized":"2024-04-25T09:28:01.140371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.379069+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:01.379069+0000","last_peered":"2024-04-25T09:28:01.379069+0000","last_clean":"2024-04-25T09:28:01.379069+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:01.379069+0000","last_undegraded":"2024-04-25T09:28:01.379069+0000","last_fullsized":"2024-04-25T09:28:01.379069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":154,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.224697+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:01.224697+0000","last_peered":"2024-04-25T09:28:01.224697+0000","last_clean":"2024-04-25T09:28:01.224697+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:01.224697+0000","last_undegraded":"2024-04-25T09:28:01.224697+0000","last_fullsized":"2024-04-25T09:28:01.224697+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.856755+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:00.856755+0000","last_peered":"2024-04-25T09:28:00.856755+0000","last_clean":"2024-04-25T09:28:00.856755+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:00.856755+0000","last_undegraded":"2024-04-25T09:28:00.856755+0000","last_fullsized":"2024-04-25T09:28:00.856755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858891+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:00.858891+0000","last_peered":"2024-04-25T09:28:00.858891+0000","last_clean":"2024-04-25T09:28:00.858891+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:00.858891+0000","last_undegraded":"2024-04-25T09:28:00.858891+0000","last_fullsized":"2024-04-25T09:28:00.858891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943694+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:00.943694+0000","last_peered":"2024-04-25T09:28:00.943694+0000","last_clean":"2024-04-25T09:28:00.943694+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:00.943694+0000","last_undegraded":"2024-04-25T09:28:00.943694+0000","last_fullsized":"2024-04-25T09:28:00.943694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.335339+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:02.335339+0000","last_peered":"2024-04-25T09:28:02.335339+0000","last_clean":"2024-04-25T09:28:02.335339+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:02.335339+0000","last_undegraded":"2024-04-25T09:28:02.335339+0000","last_fullsized":"2024-04-25T09:28:02.335339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.848353+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:00.848353+0000","last_peered":"2024-04-25T09:28:00.848353+0000","last_clean":"2024-04-25T09:28:00.848353+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:00.848353+0000","last_undegraded":"2024-04-25T09:28:00.848353+0000","last_fullsized":"2024-04-25T09:28:00.848353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'23","reported_seq":36,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.691409+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:01.691409+0000","last_peered":"2024-04-25T09:28:01.691409+0000","last_clean":"2024-04-25T09:28:01.691409+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:01.691409+0000","last_undegraded":"2024-04-25T09:28:01.691409+0000","last_fullsized":"2024-04-25T09:28:01.691409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943055+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:00.943055+0000","last_peered":"2024-04-25T09:28:00.943055+0000","last_clean":"2024-04-25T09:28:00.943055+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:00.943055+0000","last_undegraded":"2024-04-25T09:28:00.943055+0000","last_fullsized":"2024-04-25T09:28:00.943055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"19'7","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.060871+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:02.060871+0000","last_peered":"2024-04-25T09:28:02.060871+0000","last_clean":"2024-04-25T09:28:02.060871+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:02.060871+0000","last_undegraded":"2024-04-25T09:28:02.060871+0000","last_fullsized":"2024-04-25T09:28:02.060871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858677+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:00.858677+0000","last_peered":"2024-04-25T09:28:00.858677+0000","last_clean":"2024-04-25T09:28:00.858677+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:00.858677+0000","last_undegraded":"2024-04-25T09:28:00.858677+0000","last_fullsized":"2024-04-25T09:28:00.858677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.862677+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:01.862677+0000","last_peered":"2024-04-25T09:28:01.862677+0000","last_clean":"2024-04-25T09:28:01.862677+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:01.862677+0000","last_undegraded":"2024-04-25T09:28:01.862677+0000","last_fullsized":"2024-04-25T09:28:01.862677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"19'23","reported_seq":39,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.324521+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:02.324521+0000","last_peered":"2024-04-25T09:28:02.324521+0000","last_clean":"2024-04-25T09:28:02.324521+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:02.324521+0000","last_undegraded":"2024-04-25T09:28:02.324521+0000","last_fullsized":"2024-04-25T09:28:02.324521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.236319+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:01.236319+0000","last_peered":"2024-04-25T09:28:01.236319+0000","last_clean":"2024-04-25T09:28:01.236319+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:01.236319+0000","last_undegraded":"2024-04-25T09:28:01.236319+0000","last_fullsized":"2024-04-25T09:28:01.236319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.230152+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:01.230152+0000","last_peered":"2024-04-25T09:28:01.230152+0000","last_clean":"2024-04-25T09:28:01.230152+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:01.230152+0000","last_undegraded":"2024-04-25T09:28:01.230152+0000","last_fullsized":"2024-04-25T09:28:01.230152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.864797+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:01.864797+0000","last_peered":"2024-04-25T09:28:01.864797+0000","last_clean":"2024-04-25T09:28:01.864797+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:01.864797+0000","last_undegraded":"2024-04-25T09:28:01.864797+0000","last_fullsized":"2024-04-25T09:28:01.864797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'7","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.269255+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:02.269255+0000","last_peered":"2024-04-25T09:28:02.269255+0000","last_clean":"2024-04-25T09:28:02.269255+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:02.269255+0000","last_undegraded":"2024-04-25T09:28:02.269255+0000","last_fullsized":"2024-04-25T09:28:02.269255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.857718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:00.857718+0000","last_peered":"2024-04-25T09:28:00.857718+0000","last_clean":"2024-04-25T09:28:00.857718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:00.857718+0000","last_undegraded":"2024-04-25T09:28:00.857718+0000","last_fullsized":"2024-04-25T09:28:00.857718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1368064,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":1336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1945600,"data_stored":3891200,"data_compressed":200160,"data_compressed_allocated":1945600,"data_compressed_original":3891200,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27808,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":1007616,"data_stored":2223074,"data_compressed":111743,"data_compressed_allocated":835584,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":958464,"data_stored":2111631,"data_compressed":105841,"data_compressed_allocated":778240,"data_compressed_original":2048000,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27156,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":339968,"data_stored":420290,"data_compressed":19364,"data_compressed_allocated":188416,"data_compressed_original":376832,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":425984,"data_stored":1059810,"data_compressed":51849,"data_compressed_allocated":253952,"data_compressed_original":999424,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":425984,"data_compressed":21882,"data_compressed_allocated":212992,"data_compressed_original":425984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":393216,"data_compressed":20206,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":1482752,"data_compressed":76296,"data_compressed_allocated":741376,"data_compressed_original":1482752,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":794624,"data_stored":1589248,"data_compressed":81776,"data_compressed_allocated":794624,"data_compressed_original":1589248,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:03.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 468 452 1.17699 1.24219 0.0784812 0.104374 2024-04-25T09:28:04.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:04.675 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:04.688+0000 7f989e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:04.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:04.695+0000 7f989e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:04.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 620 604 1.17959 1.1875 0.125799 0.10382 2024-04-25T09:28:05.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 801 785 1.22646 1.41406 0.169877 0.101131 2024-04-25T09:28:06.804 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:06.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 978 962 1.25249 1.38281 0.0867055 0.0985348 2024-04-25T09:28:06.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:06.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:06.960+0000 7fd14f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:06.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:06.972+0000 7fd14f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.084+0000 7f770e51d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.077 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.092+0000 7f770e51d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.199 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:07.200 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:07.216 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T09:28:05.227372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1958432,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":304,"num_write_kb":3230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":252,"ondisk_log_size":252,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":109964,"kb_used_data":2668,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377377396,"statfs":{"total":386547056640,"available":386434453504,"internally_reserved":0,"allocated":2732032,"data_stored":5814805,"data_compressed":288797,"data_compressed_allocated":2056192,"data_compressed_original":5586944,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1368064,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":1336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001147"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.945581+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:00.945581+0000","last_peered":"2024-04-25T09:28:00.945581+0000","last_clean":"2024-04-25T09:28:00.945581+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:00.945581+0000","last_undegraded":"2024-04-25T09:28:00.945581+0000","last_fullsized":"2024-04-25T09:28:00.945581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'31","reported_seq":47,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.159919+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:02.159919+0000","last_peered":"2024-04-25T09:28:02.159919+0000","last_clean":"2024-04-25T09:28:02.159919+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:02.159919+0000","last_undegraded":"2024-04-25T09:28:02.159919+0000","last_fullsized":"2024-04-25T09:28:02.159919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'15","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.361749+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:01.361749+0000","last_peered":"2024-04-25T09:28:01.361749+0000","last_clean":"2024-04-25T09:28:01.361749+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:01.361749+0000","last_undegraded":"2024-04-25T09:28:01.361749+0000","last_fullsized":"2024-04-25T09:28:01.361749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.043347+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:01.043347+0000","last_peered":"2024-04-25T09:28:01.043347+0000","last_clean":"2024-04-25T09:28:01.043347+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:01.043347+0000","last_undegraded":"2024-04-25T09:28:01.043347+0000","last_fullsized":"2024-04-25T09:28:01.043347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'15","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.143054+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:02.143054+0000","last_peered":"2024-04-25T09:28:02.143054+0000","last_clean":"2024-04-25T09:28:02.143054+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:02.143054+0000","last_undegraded":"2024-04-25T09:28:02.143054+0000","last_fullsized":"2024-04-25T09:28:02.143054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.231310+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:01.231310+0000","last_peered":"2024-04-25T09:28:01.231310+0000","last_clean":"2024-04-25T09:28:01.231310+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:01.231310+0000","last_undegraded":"2024-04-25T09:28:01.231310+0000","last_fullsized":"2024-04-25T09:28:01.231310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.140371+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:01.140371+0000","last_peered":"2024-04-25T09:28:01.140371+0000","last_clean":"2024-04-25T09:28:01.140371+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:01.140371+0000","last_undegraded":"2024-04-25T09:28:01.140371+0000","last_fullsized":"2024-04-25T09:28:01.140371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'6","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.379069+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:01.379069+0000","last_peered":"2024-04-25T09:28:01.379069+0000","last_clean":"2024-04-25T09:28:01.379069+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:01.379069+0000","last_undegraded":"2024-04-25T09:28:01.379069+0000","last_fullsized":"2024-04-25T09:28:01.379069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":154,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.224697+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:01.224697+0000","last_peered":"2024-04-25T09:28:01.224697+0000","last_clean":"2024-04-25T09:28:01.224697+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:01.224697+0000","last_undegraded":"2024-04-25T09:28:01.224697+0000","last_fullsized":"2024-04-25T09:28:01.224697+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.856755+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:00.856755+0000","last_peered":"2024-04-25T09:28:00.856755+0000","last_clean":"2024-04-25T09:28:00.856755+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:00.856755+0000","last_undegraded":"2024-04-25T09:28:00.856755+0000","last_fullsized":"2024-04-25T09:28:00.856755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858891+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:00.858891+0000","last_peered":"2024-04-25T09:28:00.858891+0000","last_clean":"2024-04-25T09:28:00.858891+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:00.858891+0000","last_undegraded":"2024-04-25T09:28:00.858891+0000","last_fullsized":"2024-04-25T09:28:00.858891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943694+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:00.943694+0000","last_peered":"2024-04-25T09:28:00.943694+0000","last_clean":"2024-04-25T09:28:00.943694+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:00.943694+0000","last_undegraded":"2024-04-25T09:28:00.943694+0000","last_fullsized":"2024-04-25T09:28:00.943694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'7","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.335339+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:02.335339+0000","last_peered":"2024-04-25T09:28:02.335339+0000","last_clean":"2024-04-25T09:28:02.335339+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:02.335339+0000","last_undegraded":"2024-04-25T09:28:02.335339+0000","last_fullsized":"2024-04-25T09:28:02.335339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.848353+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:00.848353+0000","last_peered":"2024-04-25T09:28:00.848353+0000","last_clean":"2024-04-25T09:28:00.848353+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:00.848353+0000","last_undegraded":"2024-04-25T09:28:00.848353+0000","last_fullsized":"2024-04-25T09:28:00.848353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'23","reported_seq":36,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.691409+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:01.691409+0000","last_peered":"2024-04-25T09:28:01.691409+0000","last_clean":"2024-04-25T09:28:01.691409+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:01.691409+0000","last_undegraded":"2024-04-25T09:28:01.691409+0000","last_fullsized":"2024-04-25T09:28:01.691409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.943055+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:00.943055+0000","last_peered":"2024-04-25T09:28:00.943055+0000","last_clean":"2024-04-25T09:28:00.943055+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:00.943055+0000","last_undegraded":"2024-04-25T09:28:00.943055+0000","last_fullsized":"2024-04-25T09:28:00.943055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"19'7","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.060871+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:02.060871+0000","last_peered":"2024-04-25T09:28:02.060871+0000","last_clean":"2024-04-25T09:28:02.060871+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:02.060871+0000","last_undegraded":"2024-04-25T09:28:02.060871+0000","last_fullsized":"2024-04-25T09:28:02.060871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.858677+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:00.858677+0000","last_peered":"2024-04-25T09:28:00.858677+0000","last_clean":"2024-04-25T09:28:00.858677+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:00.858677+0000","last_undegraded":"2024-04-25T09:28:00.858677+0000","last_fullsized":"2024-04-25T09:28:00.858677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.862677+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:01.862677+0000","last_peered":"2024-04-25T09:28:01.862677+0000","last_clean":"2024-04-25T09:28:01.862677+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:01.862677+0000","last_undegraded":"2024-04-25T09:28:01.862677+0000","last_fullsized":"2024-04-25T09:28:01.862677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"19'23","reported_seq":39,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.324521+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:02.324521+0000","last_peered":"2024-04-25T09:28:02.324521+0000","last_clean":"2024-04-25T09:28:02.324521+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:02.324521+0000","last_undegraded":"2024-04-25T09:28:02.324521+0000","last_fullsized":"2024-04-25T09:28:02.324521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.236319+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:01.236319+0000","last_peered":"2024-04-25T09:28:01.236319+0000","last_clean":"2024-04-25T09:28:01.236319+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:01.236319+0000","last_undegraded":"2024-04-25T09:28:01.236319+0000","last_fullsized":"2024-04-25T09:28:01.236319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.230152+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:01.230152+0000","last_peered":"2024-04-25T09:28:01.230152+0000","last_clean":"2024-04-25T09:28:01.230152+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:01.230152+0000","last_undegraded":"2024-04-25T09:28:01.230152+0000","last_fullsized":"2024-04-25T09:28:01.230152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.864797+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:01.864797+0000","last_peered":"2024-04-25T09:28:01.864797+0000","last_clean":"2024-04-25T09:28:01.864797+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:01.864797+0000","last_undegraded":"2024-04-25T09:28:01.864797+0000","last_fullsized":"2024-04-25T09:28:01.864797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'7","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.269255+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:02.269255+0000","last_peered":"2024-04-25T09:28:02.269255+0000","last_clean":"2024-04-25T09:28:02.269255+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:02.269255+0000","last_undegraded":"2024-04-25T09:28:02.269255+0000","last_fullsized":"2024-04-25T09:28:02.269255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T09:28:00.857718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:00.857718+0000","last_peered":"2024-04-25T09:28:00.857718+0000","last_clean":"2024-04-25T09:28:00.857718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:00.857718+0000","last_undegraded":"2024-04-25T09:28:00.857718+0000","last_fullsized":"2024-04-25T09:28:00.857718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1368064,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":1336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1945600,"data_stored":3891200,"data_compressed":200160,"data_compressed_allocated":1945600,"data_compressed_original":3891200,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27808,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":1007616,"data_stored":2223074,"data_compressed":111743,"data_compressed_allocated":835584,"data_compressed_original":2162688,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":958464,"data_stored":2111631,"data_compressed":105841,"data_compressed_allocated":778240,"data_compressed_original":2048000,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27156,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":339968,"data_stored":420290,"data_compressed":19364,"data_compressed_allocated":188416,"data_compressed_original":376832,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":425984,"data_stored":1059810,"data_compressed":51849,"data_compressed_allocated":253952,"data_compressed_original":999424,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":425984,"data_compressed":21882,"data_compressed_allocated":212992,"data_compressed_original":425984,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":393216,"data_compressed":20206,"data_compressed_allocated":196608,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":1482752,"data_compressed":76296,"data_compressed_allocated":741376,"data_compressed_original":1482752,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":794624,"data_stored":1589248,"data_compressed":81776,"data_compressed_allocated":794624,"data_compressed_original":1589248,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:07.217 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:28:07.217 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:07.217 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:28:07.218 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:28:07.408 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.415+0000 7f638fcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.428+0000 7f638fcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:07.444 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:07.445 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:07.445 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:07.445 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:07.447 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:07.447 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:07.447 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:28:07.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.603+0000 7f186cb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.616+0000 7f186cb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.623 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:07.624 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:07.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:07.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:07.627 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:28:07.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.764+0000 7ff7f2cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.778+0000 7ff7f2cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:07.832 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:07.833 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:07.833 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:07.833 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:07.835 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:07.835 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:07.836 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:28:07.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 1130 1114 1.24319 1.1875 0.0517191 0.0997505 2024-04-25T09:28:07.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:07.997+0000 7f6da635d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:07.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:08.009+0000 7f6da635d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:08.077 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:08.080 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:08.080 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:08.890 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1296 1280 1.24989 1.29688 0.129966 0.0993971 2024-04-25T09:28:09.319 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:09.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:09.471+0000 7f7f66bff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:09.462 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:09.477+0000 7f7f6599d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:09.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1451 1435 1.24555 1.21094 0.221483 0.0995101 2024-04-25T09:28:10.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 1630 1614 1.26082 1.39844 0.0185862 0.0985369 2024-04-25T09:28:11.616 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:11.780 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:11.793+0000 7fef6139d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:11.786 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:11.800+0000 7fef6139d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:11.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1802 1786 1.26835 1.34375 0.0720983 0.0979667 2024-04-25T09:28:12.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1965 1949 1.26876 1.27344 0.0217587 0.0980248 2024-04-25T09:28:13.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:13.081 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:28:13.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:13.230+0000 7f5fdb06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:13.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:13.245+0000 7f5fdb06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:13.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 2139 2123 1.27573 1.35938 0.109213 0.0975895 2024-04-25T09:28:14.013 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:14.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:14.160+0000 7fa44699d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:14.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:14.168+0000 7fa44699d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:14.267 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:28:14.285 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:28:14.427 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:14.434+0000 7ffa3c02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:14.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:14.445+0000 7ffa3c02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:14.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 2304 2288 1.27667 1.28906 0.118546 0.0975373 2024-04-25T09:28:15.276 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:28:15.291 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:28:15.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:15.469+0000 7fca0466d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:15.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:15.482+0000 7fca0466d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:15.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2460 2444 1.2728 1.21875 0.215311 0.0976604 2024-04-25T09:28:16.280 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:28:16.301 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:28:16.404 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:16.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:16.443+0000 7f0d13aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:16.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:16.464+0000 7f0d13aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:16.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:16.572+0000 7f17c7ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:16.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:16.578+0000 7f17c7ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:16.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2603 2587 1.26307 1.11719 0.123725 0.0985787 2024-04-25T09:28:17.290 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:28:17.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:28:17.308 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:17.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:17.509+0000 7fdbe279d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:17.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:17.517+0000 7fdbe279d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:17.778 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:17.779 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:17.798 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T09:28:17.308294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18596384,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2335,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2282,"ondisk_log_size":2282,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":153064,"kb_used_data":24968,"kb_used_omap":0,"kb_used_meta":128064,"kb_avail":377334296,"statfs":{"total":386547056640,"available":386390319104,"internally_reserved":0,"allocated":25567232,"data_stored":51445788,"data_compressed":2641914,"data_compressed_allocated":24866816,"data_compressed_original":51208192,"omap_allocated":0,"internal_metadata":131137536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3604480,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.079170"},"pg_stats":[{"pgid":"3.f","version":"21'159","reported_seq":179,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.281230+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:16.281230+0000","last_peered":"2024-04-25T09:28:16.281230+0000","last_clean":"2024-04-25T09:28:16.281230+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:16.281230+0000","last_undegraded":"2024-04-25T09:28:16.281230+0000","last_fullsized":"2024-04-25T09:28:16.281230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'119","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.231393+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:12.231393+0000","last_peered":"2024-04-25T09:28:12.231393+0000","last_clean":"2024-04-25T09:28:12.231393+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:12.231393+0000","last_undegraded":"2024-04-25T09:28:12.231393+0000","last_fullsized":"2024-04-25T09:28:12.231393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'155","reported_seq":175,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.372493+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:16.372493+0000","last_peered":"2024-04-25T09:28:16.372493+0000","last_clean":"2024-04-25T09:28:16.372493+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:16.372493+0000","last_undegraded":"2024-04-25T09:28:16.372493+0000","last_fullsized":"2024-04-25T09:28:16.372493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277952,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'104","reported_seq":123,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.004669+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:16.004669+0000","last_peered":"2024-04-25T09:28:16.004669+0000","last_clean":"2024-04-25T09:28:16.004669+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:16.004669+0000","last_undegraded":"2024-04-25T09:28:16.004669+0000","last_fullsized":"2024-04-25T09:28:16.004669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'95","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.337626+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:12.337626+0000","last_peered":"2024-04-25T09:28:12.337626+0000","last_clean":"2024-04-25T09:28:12.337626+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:12.337626+0000","last_undegraded":"2024-04-25T09:28:12.337626+0000","last_fullsized":"2024-04-25T09:28:12.337626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'263","reported_seq":283,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.162975+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:16.162975+0000","last_peered":"2024-04-25T09:28:16.162975+0000","last_clean":"2024-04-25T09:28:16.162975+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:16.162975+0000","last_undegraded":"2024-04-25T09:28:16.162975+0000","last_fullsized":"2024-04-25T09:28:16.162975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'175","reported_seq":195,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.092768+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:16.092768+0000","last_peered":"2024-04-25T09:28:16.092768+0000","last_clean":"2024-04-25T09:28:16.092768+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:16.092768+0000","last_undegraded":"2024-04-25T09:28:16.092768+0000","last_fullsized":"2024-04-25T09:28:16.092768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"19'224","reported_seq":243,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.003194+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:16.003194+0000","last_peered":"2024-04-25T09:28:16.003194+0000","last_clean":"2024-04-25T09:28:16.003194+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:16.003194+0000","last_undegraded":"2024-04-25T09:28:16.003194+0000","last_fullsized":"2024-04-25T09:28:16.003194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.595799+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:02.595799+0000","last_peered":"2024-04-25T09:28:02.595799+0000","last_clean":"2024-04-25T09:28:02.595799+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:02.595799+0000","last_undegraded":"2024-04-25T09:28:02.595799+0000","last_fullsized":"2024-04-25T09:28:02.595799+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.008304+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:16.008304+0000","last_peered":"2024-04-25T09:28:16.008304+0000","last_clean":"2024-04-25T09:28:16.008304+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:16.008304+0000","last_undegraded":"2024-04-25T09:28:16.008304+0000","last_fullsized":"2024-04-25T09:28:16.008304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'80","reported_seq":99,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.007512+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:16.007512+0000","last_peered":"2024-04-25T09:28:16.007512+0000","last_clean":"2024-04-25T09:28:16.007512+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:16.007512+0000","last_undegraded":"2024-04-25T09:28:16.007512+0000","last_fullsized":"2024-04-25T09:28:16.007512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.007210+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:16.007210+0000","last_peered":"2024-04-25T09:28:16.007210+0000","last_clean":"2024-04-25T09:28:16.007210+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:16.007210+0000","last_undegraded":"2024-04-25T09:28:16.007210+0000","last_fullsized":"2024-04-25T09:28:16.007210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"19'159","reported_seq":175,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.411408+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:11.411408+0000","last_peered":"2024-04-25T09:28:11.411408+0000","last_clean":"2024-04-25T09:28:11.411408+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:11.411408+0000","last_undegraded":"2024-04-25T09:28:11.411408+0000","last_fullsized":"2024-04-25T09:28:11.411408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:15.991141+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:15.991141+0000","last_peered":"2024-04-25T09:28:15.991141+0000","last_clean":"2024-04-25T09:28:15.991141+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:15.991141+0000","last_undegraded":"2024-04-25T09:28:15.991141+0000","last_fullsized":"2024-04-25T09:28:15.991141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"19'119","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.181537+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:12.181537+0000","last_peered":"2024-04-25T09:28:12.181537+0000","last_clean":"2024-04-25T09:28:12.181537+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:12.181537+0000","last_undegraded":"2024-04-25T09:28:12.181537+0000","last_fullsized":"2024-04-25T09:28:12.181537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.005494+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:16.005494+0000","last_peered":"2024-04-25T09:28:16.005494+0000","last_clean":"2024-04-25T09:28:16.005494+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:16.005494+0000","last_undegraded":"2024-04-25T09:28:16.005494+0000","last_fullsized":"2024-04-25T09:28:16.005494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"19'105","reported_seq":121,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.397531+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:12.397531+0000","last_peered":"2024-04-25T09:28:12.397531+0000","last_clean":"2024-04-25T09:28:12.397531+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:12.397531+0000","last_undegraded":"2024-04-25T09:28:12.397531+0000","last_fullsized":"2024-04-25T09:28:12.397531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":868352,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"21'135","reported_seq":155,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.287183+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:16.287183+0000","last_peered":"2024-04-25T09:28:16.287183+0000","last_clean":"2024-04-25T09:28:16.287183+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:16.287183+0000","last_undegraded":"2024-04-25T09:28:16.287183+0000","last_fullsized":"2024-04-25T09:28:16.287183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.862677+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:01.862677+0000","last_peered":"2024-04-25T09:28:01.862677+0000","last_clean":"2024-04-25T09:28:01.862677+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:01.862677+0000","last_undegraded":"2024-04-25T09:28:01.862677+0000","last_fullsized":"2024-04-25T09:28:01.862677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"19'143","reported_seq":159,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.590059+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:11.590059+0000","last_peered":"2024-04-25T09:28:11.590059+0000","last_clean":"2024-04-25T09:28:11.590059+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:11.590059+0000","last_undegraded":"2024-04-25T09:28:11.590059+0000","last_fullsized":"2024-04-25T09:28:11.590059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.603331+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:02.603331+0000","last_peered":"2024-04-25T09:28:02.603331+0000","last_clean":"2024-04-25T09:28:02.603331+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:02.603331+0000","last_undegraded":"2024-04-25T09:28:02.603331+0000","last_fullsized":"2024-04-25T09:28:02.603331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"19'63","reported_seq":79,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:10.788544+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:10.788544+0000","last_peered":"2024-04-25T09:28:10.788544+0000","last_clean":"2024-04-25T09:28:10.788544+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:10.788544+0000","last_undegraded":"2024-04-25T09:28:10.788544+0000","last_fullsized":"2024-04-25T09:28:10.788544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.864797+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:01.864797+0000","last_peered":"2024-04-25T09:28:01.864797+0000","last_clean":"2024-04-25T09:28:01.864797+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:01.864797+0000","last_undegraded":"2024-04-25T09:28:01.864797+0000","last_fullsized":"2024-04-25T09:28:01.864797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'87","reported_seq":103,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.211195+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:11.211195+0000","last_peered":"2024-04-25T09:28:11.211195+0000","last_clean":"2024-04-25T09:28:11.211195+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:11.211195+0000","last_undegraded":"2024-04-25T09:28:11.211195+0000","last_fullsized":"2024-04-25T09:28:11.211195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.013423+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:16.013423+0000","last_peered":"2024-04-25T09:28:16.013423+0000","last_clean":"2024-04-25T09:28:16.013423+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:16.013423+0000","last_undegraded":"2024-04-25T09:28:16.013423+0000","last_fullsized":"2024-04-25T09:28:16.013423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":18006016,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2198,"num_write_kb":17584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26714112,"data_stored":53428224,"data_compressed":2755476,"data_compressed_allocated":26714112,"data_compressed_original":53428224,"omap_allocated":0,"internal_metadata":0},"log_size":2185,"ondisk_log_size":2185,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36720,"kb_used_data":5736,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":5873664,"data_stored":11942031,"data_compressed":612767,"data_compressed_allocated":5693440,"data_compressed_original":11878400,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36160,"kb_used_data":5176,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":5300224,"data_stored":10795151,"data_compressed":553721,"data_compressed_allocated":5120000,"data_compressed_original":10731520,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42496,"kb_used_data":7352,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94329344,"statfs":{"total":96636764160,"available":96593248256,"internally_reserved":0,"allocated":7528448,"data_stored":14784111,"data_compressed":760099,"data_compressed_allocated":7368704,"data_compressed_original":14737408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37688,"kb_used_data":6704,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334152,"statfs":{"total":96636764160,"available":96598171648,"internally_reserved":0,"allocated":6864896,"data_stored":13924495,"data_compressed":715327,"data_compressed_allocated":6684672,"data_compressed_original":13860864,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":14262272,"data_compressed":735697,"data_compressed_allocated":7131136,"data_compressed_original":14262272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7790592,"data_stored":15581184,"data_compressed":803668,"data_compressed_allocated":7790592,"data_compressed_original":15581184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5562368,"data_stored":11124736,"data_compressed":573668,"data_compressed_allocated":5562368,"data_compressed_original":11124736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6230016,"data_stored":12460032,"data_compressed":642443,"data_compressed_allocated":6230016,"data_compressed_original":12460032,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:17.799 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:17.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2752 2736 1.25724 1.16406 0.183659 0.0989708 2024-04-25T09:28:17.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:17.977+0000 7f4227e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:17.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:17.991+0000 7f4227e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:18.260 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:18.261 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:18.275 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T09:28:17.308294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18596384,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2335,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2282,"ondisk_log_size":2282,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":153064,"kb_used_data":24968,"kb_used_omap":0,"kb_used_meta":128064,"kb_avail":377334296,"statfs":{"total":386547056640,"available":386390319104,"internally_reserved":0,"allocated":25567232,"data_stored":51445788,"data_compressed":2641914,"data_compressed_allocated":24866816,"data_compressed_original":51208192,"omap_allocated":0,"internal_metadata":131137536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3604480,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.079170"},"pg_stats":[{"pgid":"3.f","version":"21'159","reported_seq":179,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.281230+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:16.281230+0000","last_peered":"2024-04-25T09:28:16.281230+0000","last_clean":"2024-04-25T09:28:16.281230+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:16.281230+0000","last_undegraded":"2024-04-25T09:28:16.281230+0000","last_fullsized":"2024-04-25T09:28:16.281230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'119","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.231393+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:12.231393+0000","last_peered":"2024-04-25T09:28:12.231393+0000","last_clean":"2024-04-25T09:28:12.231393+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:12.231393+0000","last_undegraded":"2024-04-25T09:28:12.231393+0000","last_fullsized":"2024-04-25T09:28:12.231393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'155","reported_seq":175,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.372493+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:16.372493+0000","last_peered":"2024-04-25T09:28:16.372493+0000","last_clean":"2024-04-25T09:28:16.372493+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:16.372493+0000","last_undegraded":"2024-04-25T09:28:16.372493+0000","last_fullsized":"2024-04-25T09:28:16.372493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277952,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'104","reported_seq":123,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.004669+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:16.004669+0000","last_peered":"2024-04-25T09:28:16.004669+0000","last_clean":"2024-04-25T09:28:16.004669+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:16.004669+0000","last_undegraded":"2024-04-25T09:28:16.004669+0000","last_fullsized":"2024-04-25T09:28:16.004669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'95","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.337626+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:12.337626+0000","last_peered":"2024-04-25T09:28:12.337626+0000","last_clean":"2024-04-25T09:28:12.337626+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:12.337626+0000","last_undegraded":"2024-04-25T09:28:12.337626+0000","last_fullsized":"2024-04-25T09:28:12.337626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'263","reported_seq":283,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.162975+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:16.162975+0000","last_peered":"2024-04-25T09:28:16.162975+0000","last_clean":"2024-04-25T09:28:16.162975+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:16.162975+0000","last_undegraded":"2024-04-25T09:28:16.162975+0000","last_fullsized":"2024-04-25T09:28:16.162975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'175","reported_seq":195,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.092768+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:16.092768+0000","last_peered":"2024-04-25T09:28:16.092768+0000","last_clean":"2024-04-25T09:28:16.092768+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:16.092768+0000","last_undegraded":"2024-04-25T09:28:16.092768+0000","last_fullsized":"2024-04-25T09:28:16.092768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"19'224","reported_seq":243,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.003194+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:16.003194+0000","last_peered":"2024-04-25T09:28:16.003194+0000","last_clean":"2024-04-25T09:28:16.003194+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:16.003194+0000","last_undegraded":"2024-04-25T09:28:16.003194+0000","last_fullsized":"2024-04-25T09:28:16.003194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.595799+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:02.595799+0000","last_peered":"2024-04-25T09:28:02.595799+0000","last_clean":"2024-04-25T09:28:02.595799+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:02.595799+0000","last_undegraded":"2024-04-25T09:28:02.595799+0000","last_fullsized":"2024-04-25T09:28:02.595799+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.008304+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:16.008304+0000","last_peered":"2024-04-25T09:28:16.008304+0000","last_clean":"2024-04-25T09:28:16.008304+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:16.008304+0000","last_undegraded":"2024-04-25T09:28:16.008304+0000","last_fullsized":"2024-04-25T09:28:16.008304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'80","reported_seq":99,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.007512+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:16.007512+0000","last_peered":"2024-04-25T09:28:16.007512+0000","last_clean":"2024-04-25T09:28:16.007512+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:16.007512+0000","last_undegraded":"2024-04-25T09:28:16.007512+0000","last_fullsized":"2024-04-25T09:28:16.007512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.007210+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:16.007210+0000","last_peered":"2024-04-25T09:28:16.007210+0000","last_clean":"2024-04-25T09:28:16.007210+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:16.007210+0000","last_undegraded":"2024-04-25T09:28:16.007210+0000","last_fullsized":"2024-04-25T09:28:16.007210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"19'159","reported_seq":175,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.411408+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:11.411408+0000","last_peered":"2024-04-25T09:28:11.411408+0000","last_clean":"2024-04-25T09:28:11.411408+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:11.411408+0000","last_undegraded":"2024-04-25T09:28:11.411408+0000","last_fullsized":"2024-04-25T09:28:11.411408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:15.991141+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:15.991141+0000","last_peered":"2024-04-25T09:28:15.991141+0000","last_clean":"2024-04-25T09:28:15.991141+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:15.991141+0000","last_undegraded":"2024-04-25T09:28:15.991141+0000","last_fullsized":"2024-04-25T09:28:15.991141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"19'119","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.181537+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:12.181537+0000","last_peered":"2024-04-25T09:28:12.181537+0000","last_clean":"2024-04-25T09:28:12.181537+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:12.181537+0000","last_undegraded":"2024-04-25T09:28:12.181537+0000","last_fullsized":"2024-04-25T09:28:12.181537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.005494+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:16.005494+0000","last_peered":"2024-04-25T09:28:16.005494+0000","last_clean":"2024-04-25T09:28:16.005494+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:16.005494+0000","last_undegraded":"2024-04-25T09:28:16.005494+0000","last_fullsized":"2024-04-25T09:28:16.005494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"19'105","reported_seq":121,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.397531+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:12.397531+0000","last_peered":"2024-04-25T09:28:12.397531+0000","last_clean":"2024-04-25T09:28:12.397531+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:12.397531+0000","last_undegraded":"2024-04-25T09:28:12.397531+0000","last_fullsized":"2024-04-25T09:28:12.397531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":868352,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"21'135","reported_seq":155,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.287183+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:16.287183+0000","last_peered":"2024-04-25T09:28:16.287183+0000","last_clean":"2024-04-25T09:28:16.287183+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:16.287183+0000","last_undegraded":"2024-04-25T09:28:16.287183+0000","last_fullsized":"2024-04-25T09:28:16.287183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.862677+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:01.862677+0000","last_peered":"2024-04-25T09:28:01.862677+0000","last_clean":"2024-04-25T09:28:01.862677+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:01.862677+0000","last_undegraded":"2024-04-25T09:28:01.862677+0000","last_fullsized":"2024-04-25T09:28:01.862677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"19'143","reported_seq":159,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.590059+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:11.590059+0000","last_peered":"2024-04-25T09:28:11.590059+0000","last_clean":"2024-04-25T09:28:11.590059+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:11.590059+0000","last_undegraded":"2024-04-25T09:28:11.590059+0000","last_fullsized":"2024-04-25T09:28:11.590059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.603331+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:02.603331+0000","last_peered":"2024-04-25T09:28:02.603331+0000","last_clean":"2024-04-25T09:28:02.603331+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:02.603331+0000","last_undegraded":"2024-04-25T09:28:02.603331+0000","last_fullsized":"2024-04-25T09:28:02.603331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"19'63","reported_seq":79,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:10.788544+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:10.788544+0000","last_peered":"2024-04-25T09:28:10.788544+0000","last_clean":"2024-04-25T09:28:10.788544+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:10.788544+0000","last_undegraded":"2024-04-25T09:28:10.788544+0000","last_fullsized":"2024-04-25T09:28:10.788544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.864797+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:01.864797+0000","last_peered":"2024-04-25T09:28:01.864797+0000","last_clean":"2024-04-25T09:28:01.864797+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:01.864797+0000","last_undegraded":"2024-04-25T09:28:01.864797+0000","last_fullsized":"2024-04-25T09:28:01.864797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'87","reported_seq":103,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.211195+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:11.211195+0000","last_peered":"2024-04-25T09:28:11.211195+0000","last_clean":"2024-04-25T09:28:11.211195+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:11.211195+0000","last_undegraded":"2024-04-25T09:28:11.211195+0000","last_fullsized":"2024-04-25T09:28:11.211195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.013423+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:16.013423+0000","last_peered":"2024-04-25T09:28:16.013423+0000","last_clean":"2024-04-25T09:28:16.013423+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:16.013423+0000","last_undegraded":"2024-04-25T09:28:16.013423+0000","last_fullsized":"2024-04-25T09:28:16.013423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":18006016,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2198,"num_write_kb":17584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26714112,"data_stored":53428224,"data_compressed":2755476,"data_compressed_allocated":26714112,"data_compressed_original":53428224,"omap_allocated":0,"internal_metadata":0},"log_size":2185,"ondisk_log_size":2185,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36720,"kb_used_data":5736,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":5873664,"data_stored":11942031,"data_compressed":612767,"data_compressed_allocated":5693440,"data_compressed_original":11878400,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36160,"kb_used_data":5176,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":5300224,"data_stored":10795151,"data_compressed":553721,"data_compressed_allocated":5120000,"data_compressed_original":10731520,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42496,"kb_used_data":7352,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94329344,"statfs":{"total":96636764160,"available":96593248256,"internally_reserved":0,"allocated":7528448,"data_stored":14784111,"data_compressed":760099,"data_compressed_allocated":7368704,"data_compressed_original":14737408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37688,"kb_used_data":6704,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334152,"statfs":{"total":96636764160,"available":96598171648,"internally_reserved":0,"allocated":6864896,"data_stored":13924495,"data_compressed":715327,"data_compressed_allocated":6684672,"data_compressed_original":13860864,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":14262272,"data_compressed":735697,"data_compressed_allocated":7131136,"data_compressed_original":14262272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7790592,"data_stored":15581184,"data_compressed":803668,"data_compressed_allocated":7790592,"data_compressed_original":15581184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5562368,"data_stored":11124736,"data_compressed":573668,"data_compressed_allocated":5562368,"data_compressed_original":11124736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6230016,"data_stored":12460032,"data_compressed":642443,"data_compressed_allocated":6230016,"data_compressed_original":12460032,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:18.277 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:28:18.277 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:18.277 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:18.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:18.433+0000 7f0b9ebcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:18.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:18.444+0000 7f0b9ebcf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:18.663 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:18.663 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:18.680 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T09:28:17.308294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18596384,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2335,"num_write_kb":19478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2282,"ondisk_log_size":2282,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":153064,"kb_used_data":24968,"kb_used_omap":0,"kb_used_meta":128064,"kb_avail":377334296,"statfs":{"total":386547056640,"available":386390319104,"internally_reserved":0,"allocated":25567232,"data_stored":51445788,"data_compressed":2641914,"data_compressed_allocated":24866816,"data_compressed_original":51208192,"omap_allocated":0,"internal_metadata":131137536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3604480,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.079170"},"pg_stats":[{"pgid":"3.f","version":"21'159","reported_seq":179,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.281230+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:16.281230+0000","last_peered":"2024-04-25T09:28:16.281230+0000","last_clean":"2024-04-25T09:28:16.281230+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:16.281230+0000","last_undegraded":"2024-04-25T09:28:16.281230+0000","last_fullsized":"2024-04-25T09:28:16.281230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"19'119","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.231393+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:12.231393+0000","last_peered":"2024-04-25T09:28:12.231393+0000","last_clean":"2024-04-25T09:28:12.231393+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:12.231393+0000","last_undegraded":"2024-04-25T09:28:12.231393+0000","last_fullsized":"2024-04-25T09:28:12.231393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'155","reported_seq":175,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.372493+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:16.372493+0000","last_peered":"2024-04-25T09:28:16.372493+0000","last_clean":"2024-04-25T09:28:16.372493+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:16.372493+0000","last_undegraded":"2024-04-25T09:28:16.372493+0000","last_fullsized":"2024-04-25T09:28:16.372493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277952,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'104","reported_seq":123,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.004669+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:16.004669+0000","last_peered":"2024-04-25T09:28:16.004669+0000","last_clean":"2024-04-25T09:28:16.004669+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:16.004669+0000","last_undegraded":"2024-04-25T09:28:16.004669+0000","last_fullsized":"2024-04-25T09:28:16.004669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'95","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.337626+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:12.337626+0000","last_peered":"2024-04-25T09:28:12.337626+0000","last_clean":"2024-04-25T09:28:12.337626+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:12.337626+0000","last_undegraded":"2024-04-25T09:28:12.337626+0000","last_fullsized":"2024-04-25T09:28:12.337626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'263","reported_seq":283,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.162975+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:16.162975+0000","last_peered":"2024-04-25T09:28:16.162975+0000","last_clean":"2024-04-25T09:28:16.162975+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:16.162975+0000","last_undegraded":"2024-04-25T09:28:16.162975+0000","last_fullsized":"2024-04-25T09:28:16.162975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'175","reported_seq":195,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.092768+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:16.092768+0000","last_peered":"2024-04-25T09:28:16.092768+0000","last_clean":"2024-04-25T09:28:16.092768+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:16.092768+0000","last_undegraded":"2024-04-25T09:28:16.092768+0000","last_fullsized":"2024-04-25T09:28:16.092768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"19'224","reported_seq":243,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.003194+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:16.003194+0000","last_peered":"2024-04-25T09:28:16.003194+0000","last_clean":"2024-04-25T09:28:16.003194+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:16.003194+0000","last_undegraded":"2024-04-25T09:28:16.003194+0000","last_fullsized":"2024-04-25T09:28:16.003194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.595799+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:02.595799+0000","last_peered":"2024-04-25T09:28:02.595799+0000","last_clean":"2024-04-25T09:28:02.595799+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:02.595799+0000","last_undegraded":"2024-04-25T09:28:02.595799+0000","last_fullsized":"2024-04-25T09:28:02.595799+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.008304+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:16.008304+0000","last_peered":"2024-04-25T09:28:16.008304+0000","last_clean":"2024-04-25T09:28:16.008304+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:16.008304+0000","last_undegraded":"2024-04-25T09:28:16.008304+0000","last_fullsized":"2024-04-25T09:28:16.008304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'80","reported_seq":99,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.007512+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:16.007512+0000","last_peered":"2024-04-25T09:28:16.007512+0000","last_clean":"2024-04-25T09:28:16.007512+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:16.007512+0000","last_undegraded":"2024-04-25T09:28:16.007512+0000","last_fullsized":"2024-04-25T09:28:16.007512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.007210+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:16.007210+0000","last_peered":"2024-04-25T09:28:16.007210+0000","last_clean":"2024-04-25T09:28:16.007210+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:16.007210+0000","last_undegraded":"2024-04-25T09:28:16.007210+0000","last_fullsized":"2024-04-25T09:28:16.007210+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"19'159","reported_seq":175,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.411408+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:11.411408+0000","last_peered":"2024-04-25T09:28:11.411408+0000","last_clean":"2024-04-25T09:28:11.411408+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:11.411408+0000","last_undegraded":"2024-04-25T09:28:11.411408+0000","last_fullsized":"2024-04-25T09:28:11.411408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:15.991141+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:15.991141+0000","last_peered":"2024-04-25T09:28:15.991141+0000","last_clean":"2024-04-25T09:28:15.991141+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:15.991141+0000","last_undegraded":"2024-04-25T09:28:15.991141+0000","last_fullsized":"2024-04-25T09:28:15.991141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"19'119","reported_seq":135,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.181537+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:12.181537+0000","last_peered":"2024-04-25T09:28:12.181537+0000","last_clean":"2024-04-25T09:28:12.181537+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:12.181537+0000","last_undegraded":"2024-04-25T09:28:12.181537+0000","last_fullsized":"2024-04-25T09:28:12.181537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.005494+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:16.005494+0000","last_peered":"2024-04-25T09:28:16.005494+0000","last_clean":"2024-04-25T09:28:16.005494+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:16.005494+0000","last_undegraded":"2024-04-25T09:28:16.005494+0000","last_fullsized":"2024-04-25T09:28:16.005494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"19'105","reported_seq":121,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:12.397531+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:12.397531+0000","last_peered":"2024-04-25T09:28:12.397531+0000","last_clean":"2024-04-25T09:28:12.397531+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:12.397531+0000","last_undegraded":"2024-04-25T09:28:12.397531+0000","last_fullsized":"2024-04-25T09:28:12.397531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":868352,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"21'135","reported_seq":155,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.287183+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:16.287183+0000","last_peered":"2024-04-25T09:28:16.287183+0000","last_clean":"2024-04-25T09:28:16.287183+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:16.287183+0000","last_undegraded":"2024-04-25T09:28:16.287183+0000","last_fullsized":"2024-04-25T09:28:16.287183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.862677+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:01.862677+0000","last_peered":"2024-04-25T09:28:01.862677+0000","last_clean":"2024-04-25T09:28:01.862677+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:01.862677+0000","last_undegraded":"2024-04-25T09:28:01.862677+0000","last_fullsized":"2024-04-25T09:28:01.862677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"19'143","reported_seq":159,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.590059+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:11.590059+0000","last_peered":"2024-04-25T09:28:11.590059+0000","last_clean":"2024-04-25T09:28:11.590059+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:11.590059+0000","last_undegraded":"2024-04-25T09:28:11.590059+0000","last_fullsized":"2024-04-25T09:28:11.590059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:02.603331+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:02.603331+0000","last_peered":"2024-04-25T09:28:02.603331+0000","last_clean":"2024-04-25T09:28:02.603331+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:02.603331+0000","last_undegraded":"2024-04-25T09:28:02.603331+0000","last_fullsized":"2024-04-25T09:28:02.603331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"19'63","reported_seq":79,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:10.788544+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:10.788544+0000","last_peered":"2024-04-25T09:28:10.788544+0000","last_clean":"2024-04-25T09:28:10.788544+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:10.788544+0000","last_undegraded":"2024-04-25T09:28:10.788544+0000","last_fullsized":"2024-04-25T09:28:10.788544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:01.864797+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:01.864797+0000","last_peered":"2024-04-25T09:28:01.864797+0000","last_clean":"2024-04-25T09:28:01.864797+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:01.864797+0000","last_undegraded":"2024-04-25T09:28:01.864797+0000","last_fullsized":"2024-04-25T09:28:01.864797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'87","reported_seq":103,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:28:11.211195+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:11.211195+0000","last_peered":"2024-04-25T09:28:11.211195+0000","last_clean":"2024-04-25T09:28:11.211195+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:11.211195+0000","last_undegraded":"2024-04-25T09:28:11.211195+0000","last_fullsized":"2024-04-25T09:28:11.211195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T09:28:16.013423+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:16.013423+0000","last_peered":"2024-04-25T09:28:16.013423+0000","last_clean":"2024-04-25T09:28:16.013423+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:16.013423+0000","last_undegraded":"2024-04-25T09:28:16.013423+0000","last_fullsized":"2024-04-25T09:28:16.013423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":18006016,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2198,"num_write_kb":17584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26714112,"data_stored":53428224,"data_compressed":2755476,"data_compressed_allocated":26714112,"data_compressed_original":53428224,"omap_allocated":0,"internal_metadata":0},"log_size":2185,"ondisk_log_size":2185,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36720,"kb_used_data":5736,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335120,"statfs":{"total":96636764160,"available":96599162880,"internally_reserved":0,"allocated":5873664,"data_stored":11942031,"data_compressed":612767,"data_compressed_allocated":5693440,"data_compressed_original":11878400,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36160,"kb_used_data":5176,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":5300224,"data_stored":10795151,"data_compressed":553721,"data_compressed_allocated":5120000,"data_compressed_original":10731520,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42496,"kb_used_data":7352,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94329344,"statfs":{"total":96636764160,"available":96593248256,"internally_reserved":0,"allocated":7528448,"data_stored":14784111,"data_compressed":760099,"data_compressed_allocated":7368704,"data_compressed_original":14737408,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37688,"kb_used_data":6704,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94334152,"statfs":{"total":96636764160,"available":96598171648,"internally_reserved":0,"allocated":6864896,"data_stored":13924495,"data_compressed":715327,"data_compressed_allocated":6684672,"data_compressed_original":13860864,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":14262272,"data_compressed":735697,"data_compressed_allocated":7131136,"data_compressed_original":14262272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7790592,"data_stored":15581184,"data_compressed":803668,"data_compressed_allocated":7790592,"data_compressed_original":15581184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5562368,"data_stored":11124736,"data_compressed":573668,"data_compressed_allocated":5562368,"data_compressed_original":11124736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6230016,"data_stored":12460032,"data_compressed":642443,"data_compressed_allocated":6230016,"data_compressed_original":12460032,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:18.859 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:18.891 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2891 2875 1.24771 1.08594 0.0476123 0.0998462 2024-04-25T09:28:19.001 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:19.014+0000 7f6a9486d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:19.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:19.023+0000 7f6a9486d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:19.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 3047 3031 1.24618 1.21875 0.0341254 0.0999347 2024-04-25T09:28:20.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:28:20.907960+0000 min lat: 0.0166385 max lat: 0.327742 avg lat: 0.100329 2024-04-25T09:28:20.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:28:20.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 3194 3178 1.24129 1.14844 0.155321 0.100329 2024-04-25T09:28:21.229 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:21.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:21.380+0000 7f39e299d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:21.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:21.387+0000 7f39e299d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:21.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 3328 3312 1.23203 1.04688 0.108624 0.101112 2024-04-25T09:28:22.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 3474 3458 1.22787 1.14062 0.158947 0.101494 2024-04-25T09:28:23.578 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:23.682 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:23.682 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:23.682 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:23.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:23.727+0000 7f75d4c13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:23.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:23.734+0000 7f75d4c13640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:23.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:23.836+0000 7efd2599d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:23.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:23.849+0000 7efd2599d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:23.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3627 3611 1.22645 1.19531 0.129866 0.101663 2024-04-25T09:28:24.168 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:24.168 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:24.190 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-25T09:28:23.231475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28230176,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":3511,"num_write_kb":28886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3455,"ondisk_log_size":3455,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":183876,"kb_used_data":39140,"kb_used_omap":0,"kb_used_meta":144704,"kb_avail":377303484,"statfs":{"total":386547056640,"available":386358767616,"internally_reserved":0,"allocated":40079360,"data_stored":80259820,"data_compressed":4127067,"data_compressed_allocated":39247872,"data_compressed_original":79970304,"omap_allocated":0,"internal_metadata":148176896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13238272,"num_objects":202,"num_object_clones":0,"num_object_copies":606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":12928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.938564"},"pg_stats":[{"pgid":"3.f","version":"23'225","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.357051+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:21.357051+0000","last_peered":"2024-04-25T09:28:21.357051+0000","last_clean":"2024-04-25T09:28:21.357051+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:21.357051+0000","last_undegraded":"2024-04-25T09:28:21.357051+0000","last_fullsized":"2024-04-25T09:28:21.357051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1851392,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":1808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'175","reported_seq":201,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.985814+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:21.985814+0000","last_peered":"2024-04-25T09:28:21.985814+0000","last_clean":"2024-04-25T09:28:21.985814+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:21.985814+0000","last_undegraded":"2024-04-25T09:28:21.985814+0000","last_fullsized":"2024-04-25T09:28:21.985814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'172","reported_seq":198,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.377030+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:21.377030+0000","last_peered":"2024-04-25T09:28:21.377030+0000","last_clean":"2024-04-25T09:28:21.377030+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:21.377030+0000","last_undegraded":"2024-04-25T09:28:21.377030+0000","last_fullsized":"2024-04-25T09:28:21.377030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1417216,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":1384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'159","reported_seq":185,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.339764+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:21.339764+0000","last_peered":"2024-04-25T09:28:21.339764+0000","last_clean":"2024-04-25T09:28:21.339764+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:21.339764+0000","last_undegraded":"2024-04-25T09:28:21.339764+0000","last_fullsized":"2024-04-25T09:28:21.339764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'191","reported_seq":219,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.899288+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:21.899288+0000","last_peered":"2024-04-25T09:28:21.899288+0000","last_clean":"2024-04-25T09:28:21.899288+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:21.899288+0000","last_undegraded":"2024-04-25T09:28:21.899288+0000","last_fullsized":"2024-04-25T09:28:21.899288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'327","reported_seq":353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.221192+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:21.221192+0000","last_peered":"2024-04-25T09:28:21.221192+0000","last_clean":"2024-04-25T09:28:21.221192+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:21.221192+0000","last_undegraded":"2024-04-25T09:28:21.221192+0000","last_fullsized":"2024-04-25T09:28:21.221192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'223","reported_seq":249,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:20.375374+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:20.375374+0000","last_peered":"2024-04-25T09:28:20.375374+0000","last_clean":"2024-04-25T09:28:20.375374+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:20.375374+0000","last_undegraded":"2024-04-25T09:28:20.375374+0000","last_fullsized":"2024-04-25T09:28:20.375374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'271","reported_seq":297,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.388226+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:21.388226+0000","last_peered":"2024-04-25T09:28:21.388226+0000","last_clean":"2024-04-25T09:28:21.388226+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:21.388226+0000","last_undegraded":"2024-04-25T09:28:21.388226+0000","last_fullsized":"2024-04-25T09:28:21.388226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'103","reported_seq":129,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.945145+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:17.945145+0000","last_peered":"2024-04-25T09:28:17.945145+0000","last_clean":"2024-04-25T09:28:17.945145+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:17.945145+0000","last_undegraded":"2024-04-25T09:28:17.945145+0000","last_fullsized":"2024-04-25T09:28:17.945145+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'335","reported_seq":363,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:22.321689+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:22.321689+0000","last_peered":"2024-04-25T09:28:22.321689+0000","last_clean":"2024-04-25T09:28:22.321689+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:22.321689+0000","last_undegraded":"2024-04-25T09:28:22.321689+0000","last_fullsized":"2024-04-25T09:28:22.321689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'235","reported_seq":263,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:22.386632+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:22.386632+0000","last_peered":"2024-04-25T09:28:22.386632+0000","last_clean":"2024-04-25T09:28:22.386632+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:22.386632+0000","last_undegraded":"2024-04-25T09:28:22.386632+0000","last_fullsized":"2024-04-25T09:28:22.386632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1933312,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":236,"num_write_kb":1888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'247","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:22.228872+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:22.228872+0000","last_peered":"2024-04-25T09:28:22.228872+0000","last_clean":"2024-04-25T09:28:22.228872+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:22.228872+0000","last_undegraded":"2024-04-25T09:28:22.228872+0000","last_fullsized":"2024-04-25T09:28:22.228872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'167","reported_seq":193,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:20.623526+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:20.623526+0000","last_peered":"2024-04-25T09:28:20.623526+0000","last_clean":"2024-04-25T09:28:20.623526+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:20.623526+0000","last_undegraded":"2024-04-25T09:28:20.623526+0000","last_fullsized":"2024-04-25T09:28:20.623526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'219","reported_seq":245,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:22.394099+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:22.394099+0000","last_peered":"2024-04-25T09:28:22.394099+0000","last_clean":"2024-04-25T09:28:22.394099+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:22.394099+0000","last_undegraded":"2024-04-25T09:28:22.394099+0000","last_fullsized":"2024-04-25T09:28:22.394099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802240,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":1760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'135","reported_seq":163,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:21.000390+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:21.000390+0000","last_peered":"2024-04-25T09:28:21.000390+0000","last_clean":"2024-04-25T09:28:21.000390+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:21.000390+0000","last_undegraded":"2024-04-25T09:28:21.000390+0000","last_fullsized":"2024-04-25T09:28:21.000390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'174","reported_seq":200,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:22.386565+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:22.386565+0000","last_peered":"2024-04-25T09:28:22.386565+0000","last_clean":"2024-04-25T09:28:22.386565+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:22.386565+0000","last_undegraded":"2024-04-25T09:28:22.386565+0000","last_fullsized":"2024-04-25T09:28:22.386565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1433600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":1400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":27639808,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3374,"num_write_kb":26992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40865792,"data_stored":81731584,"data_compressed":4216941,"data_compressed_allocated":40865792,"data_compressed_original":81731584,"omap_allocated":0,"internal_metadata":0},"log_size":3358,"ondisk_log_size":3358,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50368,"kb_used_data":11064,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94321472,"statfs":{"total":96636764160,"available":96585187328,"internally_reserved":0,"allocated":11329536,"data_stored":22801219,"data_compressed":1172819,"data_compressed_allocated":11116544,"data_compressed_original":22724608,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44668,"kb_used_data":9524,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327172,"statfs":{"total":96636764160,"available":96591024128,"internally_reserved":0,"allocated":9752576,"data_stored":19647299,"data_compressed":1010138,"data_compressed_allocated":9539584,"data_compressed_original":19570688,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44728,"kb_used_data":9584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327112,"statfs":{"total":96636764160,"available":96590962688,"internally_reserved":0,"allocated":9814016,"data_stored":19302691,"data_compressed":992749,"data_compressed_allocated":9621504,"data_compressed_original":19243008,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44112,"kb_used_data":8968,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327728,"statfs":{"total":96636764160,"available":96591593472,"internally_reserved":0,"allocated":9183232,"data_stored":18508611,"data_compressed":951361,"data_compressed_allocated":8970240,"data_compressed_original":18432000,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9297920,"data_stored":18595840,"data_compressed":959464,"data_compressed_allocated":9297920,"data_compressed_original":18595840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10121216,"data_stored":20242432,"data_compressed":1044355,"data_compressed_allocated":10121216,"data_compressed_original":20242432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9859072,"data_stored":19718144,"data_compressed":1017395,"data_compressed_allocated":9859072,"data_compressed_original":19718144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11587584,"data_stored":23175168,"data_compressed":1195727,"data_compressed_allocated":11587584,"data_compressed_original":23175168,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:24.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3780 3764 1.22515 1.19531 0.0417018 0.101809 2024-04-25T09:28:25.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 3949 3933 1.22895 1.32031 0.12246 0.10149 2024-04-25T09:28:25.910 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:26.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:26.073+0000 7f2187c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:26.066 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:26.081+0000 7f2187c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:26.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 4119 4103 1.23276 1.32812 0.148903 0.101135 2024-04-25T09:28:27.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 4283 4267 1.23455 1.28125 0.0445598 0.101031 2024-04-25T09:28:28.240 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:28.403+0000 7f5815754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:28.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:28.410+0000 7f5815754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:28.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 4435 4419 1.23287 1.1875 0.0701819 0.101119 2024-04-25T09:28:29.192 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:29.192 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:29.193 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:29.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:29.341+0000 7f5d0766d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:29.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:29.352+0000 7f5d0766d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:29.656 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:29.656 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:29.674 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T09:28:29.232722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34267680,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":4248,"num_write_kb":34782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4192,"ondisk_log_size":4192,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":201300,"kb_used_data":48244,"kb_used_omap":0,"kb_used_meta":153024,"kb_avail":377286060,"statfs":{"total":386547056640,"available":386340925440,"internally_reserved":0,"allocated":49401856,"data_stored":98904812,"data_compressed":5089815,"data_compressed_allocated":48570368,"data_compressed_original":98615296,"omap_allocated":0,"internal_metadata":156696576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15671296,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1913,"num_write_kb":15304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.924428"},"pg_stats":[{"pgid":"3.f","version":"23'279","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.316237+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:26.316237+0000","last_peered":"2024-04-25T09:28:26.316237+0000","last_clean":"2024-04-25T09:28:26.316237+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:26.316237+0000","last_undegraded":"2024-04-25T09:28:26.316237+0000","last_fullsized":"2024-04-25T09:28:26.316237+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'191","reported_seq":217,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:27.214248+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:27.214248+0000","last_peered":"2024-04-25T09:28:27.214248+0000","last_clean":"2024-04-25T09:28:27.214248+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:27.214248+0000","last_undegraded":"2024-04-25T09:28:27.214248+0000","last_fullsized":"2024-04-25T09:28:27.214248+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'223","reported_seq":249,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:25.706269+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:25.706269+0000","last_peered":"2024-04-25T09:28:25.706269+0000","last_clean":"2024-04-25T09:28:25.706269+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:25.706269+0000","last_undegraded":"2024-04-25T09:28:25.706269+0000","last_fullsized":"2024-04-25T09:28:25.706269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'191","reported_seq":217,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.068474+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:26.068474+0000","last_peered":"2024-04-25T09:28:26.068474+0000","last_clean":"2024-04-25T09:28:26.068474+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:26.068474+0000","last_undegraded":"2024-04-25T09:28:26.068474+0000","last_fullsized":"2024-04-25T09:28:26.068474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'207","reported_seq":235,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.855338+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:26.855338+0000","last_peered":"2024-04-25T09:28:26.855338+0000","last_clean":"2024-04-25T09:28:26.855338+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:26.855338+0000","last_undegraded":"2024-04-25T09:28:26.855338+0000","last_fullsized":"2024-04-25T09:28:26.855338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'367","reported_seq":393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.322082+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:26.322082+0000","last_peered":"2024-04-25T09:28:26.322082+0000","last_clean":"2024-04-25T09:28:26.322082+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:26.322082+0000","last_undegraded":"2024-04-25T09:28:26.322082+0000","last_fullsized":"2024-04-25T09:28:26.322082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'245","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.379873+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:26.379873+0000","last_peered":"2024-04-25T09:28:26.379873+0000","last_clean":"2024-04-25T09:28:26.379873+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:26.379873+0000","last_undegraded":"2024-04-25T09:28:26.379873+0000","last_fullsized":"2024-04-25T09:28:26.379873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2015232,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":1968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'296","reported_seq":322,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:25.385201+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:25.385201+0000","last_peered":"2024-04-25T09:28:25.385201+0000","last_clean":"2024-04-25T09:28:25.385201+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:25.385201+0000","last_undegraded":"2024-04-25T09:28:25.385201+0000","last_fullsized":"2024-04-25T09:28:25.385201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2433024,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'143","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:25.954574+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:25.954574+0000","last_peered":"2024-04-25T09:28:25.954574+0000","last_clean":"2024-04-25T09:28:25.954574+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:25.954574+0000","last_undegraded":"2024-04-25T09:28:25.954574+0000","last_fullsized":"2024-04-25T09:28:25.954574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'399","reported_seq":427,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.940189+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:26.940189+0000","last_peered":"2024-04-25T09:28:26.940189+0000","last_clean":"2024-04-25T09:28:26.940189+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:26.940189+0000","last_undegraded":"2024-04-25T09:28:26.940189+0000","last_fullsized":"2024-04-25T09:28:26.940189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'311","reported_seq":339,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.218329+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:26.218329+0000","last_peered":"2024-04-25T09:28:26.218329+0000","last_clean":"2024-04-25T09:28:26.218329+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:26.218329+0000","last_undegraded":"2024-04-25T09:28:26.218329+0000","last_fullsized":"2024-04-25T09:28:26.218329+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'287","reported_seq":313,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:26.724430+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:26.724430+0000","last_peered":"2024-04-25T09:28:26.724430+0000","last_clean":"2024-04-25T09:28:26.724430+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:26.724430+0000","last_undegraded":"2024-04-25T09:28:26.724430+0000","last_fullsized":"2024-04-25T09:28:26.724430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'239","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:25.901871+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:25.901871+0000","last_peered":"2024-04-25T09:28:25.901871+0000","last_clean":"2024-04-25T09:28:25.901871+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:25.901871+0000","last_undegraded":"2024-04-25T09:28:25.901871+0000","last_fullsized":"2024-04-25T09:28:25.901871+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'271","reported_seq":297,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:27.362330+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:27.362330+0000","last_peered":"2024-04-25T09:28:27.362330+0000","last_clean":"2024-04-25T09:28:27.362330+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:27.362330+0000","last_undegraded":"2024-04-25T09:28:27.362330+0000","last_fullsized":"2024-04-25T09:28:27.362330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'175","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:25.837989+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:25.837989+0000","last_peered":"2024-04-25T09:28:25.837989+0000","last_clean":"2024-04-25T09:28:25.837989+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:25.837989+0000","last_undegraded":"2024-04-25T09:28:25.837989+0000","last_fullsized":"2024-04-25T09:28:25.837989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'271","reported_seq":297,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:27.308924+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:27.308924+0000","last_peered":"2024-04-25T09:28:27.308924+0000","last_clean":"2024-04-25T09:28:27.308924+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:27.308924+0000","last_undegraded":"2024-04-25T09:28:27.308924+0000","last_fullsized":"2024-04-25T09:28:27.308924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":33677312,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4111,"num_write_kb":32888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50573312,"data_stored":101146624,"data_compressed":5219451,"data_compressed_allocated":50573312,"data_compressed_original":101146624,"omap_allocated":0,"internal_metadata":0},"log_size":4095,"ondisk_log_size":4095,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53200,"kb_used_data":13896,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94318640,"statfs":{"total":96636764160,"available":96582287360,"internally_reserved":0,"allocated":14229504,"data_stored":28601155,"data_compressed":1472303,"data_compressed_allocated":14016512,"data_compressed_original":28524544,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50816,"kb_used_data":11512,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":11788288,"data_stored":23718723,"data_compressed":1220369,"data_compressed_allocated":11575296,"data_compressed_original":23642112,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51372,"kb_used_data":12068,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":12357632,"data_stored":24389923,"data_compressed":1255432,"data_compressed_allocated":12165120,"data_compressed_original":24330240,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45912,"kb_used_data":10768,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94325928,"statfs":{"total":96636764160,"available":96589750272,"internally_reserved":0,"allocated":11026432,"data_stored":22195011,"data_compressed":1141711,"data_compressed_allocated":10813440,"data_compressed_original":22118400,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11251712,"data_stored":22503424,"data_compressed":1161235,"data_compressed_allocated":11251712,"data_compressed_original":22503424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12685312,"data_stored":25370624,"data_compressed":1309153,"data_compressed_allocated":12685312,"data_compressed_original":25370624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12107776,"data_stored":24215552,"data_compressed":1249622,"data_compressed_allocated":12107776,"data_compressed_original":24215552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14528512,"data_stored":29057024,"data_compressed":1499441,"data_compressed_allocated":14528512,"data_compressed_original":29057024,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:29.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 4583 4567 1.23022 1.15625 0.102143 0.10138 2024-04-25T09:28:30.630 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:30.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:30.784+0000 7f2f7e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:30.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:30.790+0000 7f2f7e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:30.892 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4728 4712 1.22697 1.13281 0.104719 0.101655 2024-04-25T09:28:31.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4881 4865 1.22594 1.19531 0.17028 0.10167 2024-04-25T09:28:32.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 5020 5004 1.22157 1.08594 0.0490867 0.102105 2024-04-25T09:28:32.986 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:33.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:33.140+0000 7fc3d4eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:33.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:33.147+0000 7fc3d4eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:33.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 5175 5159 1.22124 1.21094 0.131289 0.102169 2024-04-25T09:28:34.677 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:34.677 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:34.677 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:34.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:34.803+0000 7f039119d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:34.812+0000 7f039119d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:34.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 5334 5318 1.22185 1.24219 0.111777 0.102133 2024-04-25T09:28:34.998 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:34.998 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:35.012 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-25T09:28:33.233625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40657440,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5028,"num_write_kb":41022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4972,"ondisk_log_size":4972,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":202468,"kb_used_data":57728,"kb_used_omap":0,"kb_used_meta":144704,"kb_avail":377284892,"statfs":{"total":386547056640,"available":386339729408,"internally_reserved":0,"allocated":59113472,"data_stored":118328044,"data_compressed":6092748,"data_compressed_allocated":58281984,"data_compressed_original":118038528,"omap_allocated":0,"internal_metadata":148176896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18735104,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2287,"num_write_kb":18296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002601"},"pg_stats":[{"pgid":"3.f","version":"23'287","reported_seq":313,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.284340+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:31.284340+0000","last_peered":"2024-04-25T09:28:31.284340+0000","last_clean":"2024-04-25T09:28:31.284340+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:31.284340+0000","last_undegraded":"2024-04-25T09:28:31.284340+0000","last_fullsized":"2024-04-25T09:28:31.284340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'247","reported_seq":273,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:32.037346+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:32.037346+0000","last_peered":"2024-04-25T09:28:32.037346+0000","last_clean":"2024-04-25T09:28:32.037346+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:32.037346+0000","last_undegraded":"2024-04-25T09:28:32.037346+0000","last_fullsized":"2024-04-25T09:28:32.037346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'287","reported_seq":313,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.143936+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:31.143936+0000","last_peered":"2024-04-25T09:28:31.143936+0000","last_clean":"2024-04-25T09:28:31.143936+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:31.143936+0000","last_undegraded":"2024-04-25T09:28:31.143936+0000","last_fullsized":"2024-04-25T09:28:31.143936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'239","reported_seq":265,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.225860+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:31.225860+0000","last_peered":"2024-04-25T09:28:31.225860+0000","last_clean":"2024-04-25T09:28:31.225860+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:31.225860+0000","last_undegraded":"2024-04-25T09:28:31.225860+0000","last_fullsized":"2024-04-25T09:28:31.225860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'263","reported_seq":291,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:32.375080+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:32.375080+0000","last_peered":"2024-04-25T09:28:32.375080+0000","last_clean":"2024-04-25T09:28:32.375080+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:32.375080+0000","last_undegraded":"2024-04-25T09:28:32.375080+0000","last_fullsized":"2024-04-25T09:28:32.375080+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'447","reported_seq":473,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.348313+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:31.348313+0000","last_peered":"2024-04-25T09:28:31.348313+0000","last_clean":"2024-04-25T09:28:31.348313+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:31.348313+0000","last_undegraded":"2024-04-25T09:28:31.348313+0000","last_fullsized":"2024-04-25T09:28:31.348313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'263","reported_seq":289,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:27.552951+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:27.552951+0000","last_peered":"2024-04-25T09:28:27.552951+0000","last_clean":"2024-04-25T09:28:27.552951+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:27.552951+0000","last_undegraded":"2024-04-25T09:28:27.552951+0000","last_fullsized":"2024-04-25T09:28:27.552951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'335","reported_seq":361,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.280124+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:31.280124+0000","last_peered":"2024-04-25T09:28:31.280124+0000","last_clean":"2024-04-25T09:28:31.280124+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:31.280124+0000","last_undegraded":"2024-04-25T09:28:31.280124+0000","last_fullsized":"2024-04-25T09:28:31.280124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'192","reported_seq":218,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:30.341942+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:30.341942+0000","last_peered":"2024-04-25T09:28:30.341942+0000","last_clean":"2024-04-25T09:28:30.341942+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:30.341942+0000","last_undegraded":"2024-04-25T09:28:30.341942+0000","last_fullsized":"2024-04-25T09:28:30.341942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1581056,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'481","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:32.353915+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:32.353915+0000","last_peered":"2024-04-25T09:28:32.353915+0000","last_clean":"2024-04-25T09:28:32.353915+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:32.353915+0000","last_undegraded":"2024-04-25T09:28:32.353915+0000","last_fullsized":"2024-04-25T09:28:32.353915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3948544,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":482,"num_write_kb":3856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'367","reported_seq":395,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.141887+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:31.141887+0000","last_peered":"2024-04-25T09:28:31.141887+0000","last_clean":"2024-04-25T09:28:31.141887+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:31.141887+0000","last_undegraded":"2024-04-25T09:28:31.141887+0000","last_fullsized":"2024-04-25T09:28:31.141887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'343","reported_seq":369,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.803076+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:31.803076+0000","last_peered":"2024-04-25T09:28:31.803076+0000","last_clean":"2024-04-25T09:28:31.803076+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:31.803076+0000","last_undegraded":"2024-04-25T09:28:31.803076+0000","last_fullsized":"2024-04-25T09:28:31.803076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'279","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:30.245691+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:30.245691+0000","last_peered":"2024-04-25T09:28:30.245691+0000","last_clean":"2024-04-25T09:28:30.245691+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:30.245691+0000","last_undegraded":"2024-04-25T09:28:30.245691+0000","last_fullsized":"2024-04-25T09:28:30.245691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'311","reported_seq":337,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.428975+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:31.428975+0000","last_peered":"2024-04-25T09:28:31.428975+0000","last_clean":"2024-04-25T09:28:31.428975+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:31.428975+0000","last_undegraded":"2024-04-25T09:28:31.428975+0000","last_fullsized":"2024-04-25T09:28:31.428975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'231","reported_seq":259,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:31.535065+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:31.535065+0000","last_peered":"2024-04-25T09:28:31.535065+0000","last_clean":"2024-04-25T09:28:31.535065+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:31.535065+0000","last_undegraded":"2024-04-25T09:28:31.535065+0000","last_fullsized":"2024-04-25T09:28:31.535065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'303","reported_seq":329,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:29.629519+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:29.629519+0000","last_peered":"2024-04-25T09:28:29.629519+0000","last_clean":"2024-04-25T09:28:29.629519+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:29.629519+0000","last_undegraded":"2024-04-25T09:28:29.629519+0000","last_fullsized":"2024-04-25T09:28:29.629519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":40067072,"num_objects":613,"num_object_clones":0,"num_object_copies":1839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4891,"num_write_kb":39128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59830272,"data_stored":119660544,"data_compressed":6175431,"data_compressed_allocated":59830272,"data_compressed_original":119660544,"omap_allocated":0,"internal_metadata":0},"log_size":4875,"ondisk_log_size":4875,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43468,"kb_used_data":16644,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94328372,"statfs":{"total":96636764160,"available":96592252928,"internally_reserved":0,"allocated":17043456,"data_stored":34229059,"data_compressed":1762904,"data_compressed_allocated":16830464,"data_compressed_original":34152448,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52984,"kb_used_data":13680,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94318856,"statfs":{"total":96636764160,"available":96582508544,"internally_reserved":0,"allocated":14008320,"data_stored":28158787,"data_compressed":1449635,"data_compressed_allocated":13795328,"data_compressed_original":28082176,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53788,"kb_used_data":14480,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94318052,"statfs":{"total":96636764160,"available":96581685248,"internally_reserved":0,"allocated":14827520,"data_stored":29329699,"data_compressed":1510501,"data_compressed_allocated":14635008,"data_compressed_original":29270016,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52228,"kb_used_data":12924,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94319612,"statfs":{"total":96636764160,"available":96583282688,"internally_reserved":0,"allocated":13234176,"data_stored":26610499,"data_compressed":1369708,"data_compressed_allocated":13021184,"data_compressed_original":26533888,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13430784,"data_stored":26861568,"data_compressed":1386271,"data_compressed_allocated":13430784,"data_compressed_original":26861568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15106048,"data_stored":30212096,"data_compressed":1559146,"data_compressed_allocated":15106048,"data_compressed_original":30212096,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14016512,"data_stored":28033024,"data_compressed":1446740,"data_compressed_allocated":14016512,"data_compressed_original":28033024,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17276928,"data_stored":34553856,"data_compressed":1783274,"data_compressed_allocated":17276928,"data_compressed_original":34553856,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:35.281 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:35.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:35.425+0000 7f25ac06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:35.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:35.433+0000 7f25ac06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:35.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 5485 5469 1.22065 1.17969 0.0245302 0.10225 2024-04-25T09:28:36.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 5645 5629 1.22146 1.25 0.0278164 0.102141 2024-04-25T09:28:37.612 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:37.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:37.774+0000 7fa7b4d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:37.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:37.785+0000 7fa7b4d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:37.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5795 5779 1.22011 1.17188 0.160732 0.102263 2024-04-25T09:28:38.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5932 5916 1.21617 1.07031 0.0224509 0.10259 2024-04-25T09:28:39.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 6088 6072 1.21623 1.21875 0.0345696 0.102579 2024-04-25T09:28:39.997 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:40.015 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:40.015 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:40.015 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:40.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:40.149+0000 7f09dfcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:40.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:40.158+0000 7f09dfcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:40.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:40.196+0000 7f60cfc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:40.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:40.207+0000 7f60cfc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:40.398 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:40.398 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:40.414 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-04-25T09:28:39.234745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":46785056,"num_objects":709,"num_object_clones":0,"num_object_copies":2127,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5776,"num_write_kb":47006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5720,"ondisk_log_size":5720,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":190652,"kb_used_data":66716,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377296708,"statfs":{"total":386547056640,"available":386351828992,"internally_reserved":0,"allocated":68317184,"data_stored":136735468,"data_compressed":7043229,"data_compressed_allocated":67485696,"data_compressed_original":136445952,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15802368,"num_objects":241,"num_object_clones":0,"num_object_copies":723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1929,"num_write_kb":15432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002424"},"pg_stats":[{"pgid":"3.f","version":"23'343","reported_seq":369,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.007677+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:36.007677+0000","last_peered":"2024-04-25T09:28:36.007677+0000","last_clean":"2024-04-25T09:28:36.007677+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:36.007677+0000","last_undegraded":"2024-04-25T09:28:36.007677+0000","last_fullsized":"2024-04-25T09:28:36.007677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'351","reported_seq":377,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.414319+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:36.414319+0000","last_peered":"2024-04-25T09:28:36.414319+0000","last_clean":"2024-04-25T09:28:36.414319+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:36.414319+0000","last_undegraded":"2024-04-25T09:28:36.414319+0000","last_fullsized":"2024-04-25T09:28:36.414319+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'319","reported_seq":345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.203293+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:36.203293+0000","last_peered":"2024-04-25T09:28:36.203293+0000","last_clean":"2024-04-25T09:28:36.203293+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:36.203293+0000","last_undegraded":"2024-04-25T09:28:36.203293+0000","last_fullsized":"2024-04-25T09:28:36.203293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'292","reported_seq":318,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.410456+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:36.410456+0000","last_peered":"2024-04-25T09:28:36.410456+0000","last_clean":"2024-04-25T09:28:36.410456+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:36.410456+0000","last_undegraded":"2024-04-25T09:28:36.410456+0000","last_fullsized":"2024-04-25T09:28:36.410456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2400256,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":2344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'303","reported_seq":331,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:37.366745+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:37.366745+0000","last_peered":"2024-04-25T09:28:37.366745+0000","last_clean":"2024-04-25T09:28:37.366745+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:37.366745+0000","last_undegraded":"2024-04-25T09:28:37.366745+0000","last_fullsized":"2024-04-25T09:28:37.366745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'495","reported_seq":521,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:35.848633+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:35.848633+0000","last_peered":"2024-04-25T09:28:35.848633+0000","last_clean":"2024-04-25T09:28:35.848633+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:35.848633+0000","last_undegraded":"2024-04-25T09:28:35.848633+0000","last_fullsized":"2024-04-25T09:28:35.848633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'279","reported_seq":305,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.085727+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:36.085727+0000","last_peered":"2024-04-25T09:28:36.085727+0000","last_clean":"2024-04-25T09:28:36.085727+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:36.085727+0000","last_undegraded":"2024-04-25T09:28:36.085727+0000","last_fullsized":"2024-04-25T09:28:36.085727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'408","reported_seq":434,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.402979+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:36.402979+0000","last_peered":"2024-04-25T09:28:36.402979+0000","last_clean":"2024-04-25T09:28:36.402979+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:36.402979+0000","last_undegraded":"2024-04-25T09:28:36.402979+0000","last_fullsized":"2024-04-25T09:28:36.402979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3350528,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":409,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'228","reported_seq":254,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.385017+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:36.385017+0000","last_peered":"2024-04-25T09:28:36.385017+0000","last_clean":"2024-04-25T09:28:36.385017+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:36.385017+0000","last_undegraded":"2024-04-25T09:28:36.385017+0000","last_fullsized":"2024-04-25T09:28:36.385017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875968,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":1832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'487","reported_seq":515,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:32.500938+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:32.500938+0000","last_peered":"2024-04-25T09:28:32.500938+0000","last_clean":"2024-04-25T09:28:32.500938+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:32.500938+0000","last_undegraded":"2024-04-25T09:28:32.500938+0000","last_fullsized":"2024-04-25T09:28:32.500938+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'407","reported_seq":435,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.616439+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:36.616439+0000","last_peered":"2024-04-25T09:28:36.616439+0000","last_clean":"2024-04-25T09:28:36.616439+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:36.616439+0000","last_undegraded":"2024-04-25T09:28:36.616439+0000","last_fullsized":"2024-04-25T09:28:36.616439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'399","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:37.329561+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:37.329561+0000","last_peered":"2024-04-25T09:28:37.329561+0000","last_clean":"2024-04-25T09:28:37.329561+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:37.329561+0000","last_undegraded":"2024-04-25T09:28:37.329561+0000","last_fullsized":"2024-04-25T09:28:37.329561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'327","reported_seq":353,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:34.525257+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:34.525257+0000","last_peered":"2024-04-25T09:28:34.525257+0000","last_clean":"2024-04-25T09:28:34.525257+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:34.525257+0000","last_undegraded":"2024-04-25T09:28:34.525257+0000","last_fullsized":"2024-04-25T09:28:34.525257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'343","reported_seq":369,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:33.748559+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:33.748559+0000","last_peered":"2024-04-25T09:28:33.748559+0000","last_clean":"2024-04-25T09:28:33.748559+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:33.748559+0000","last_undegraded":"2024-04-25T09:28:33.748559+0000","last_fullsized":"2024-04-25T09:28:33.748559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'275","reported_seq":303,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:37.382055+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:37.382055+0000","last_peered":"2024-04-25T09:28:37.382055+0000","last_clean":"2024-04-25T09:28:37.382055+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:37.382055+0000","last_undegraded":"2024-04-25T09:28:37.382055+0000","last_fullsized":"2024-04-25T09:28:37.382055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2260992,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":2208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'367","reported_seq":393,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:36.860702+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:36.860702+0000","last_peered":"2024-04-25T09:28:36.860702+0000","last_clean":"2024-04-25T09:28:36.860702+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:36.860702+0000","last_undegraded":"2024-04-25T09:28:36.860702+0000","last_fullsized":"2024-04-25T09:28:36.860702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":46194688,"num_objects":707,"num_object_clones":0,"num_object_copies":2121,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5639,"num_write_kb":45112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69214208,"data_stored":138428416,"data_compressed":7144524,"data_compressed_allocated":69214208,"data_compressed_original":138428416,"omap_allocated":0,"internal_metadata":0},"log_size":5623,"ondisk_log_size":5623,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50360,"kb_used_data":19376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94321480,"statfs":{"total":96636764160,"available":96585195520,"internally_reserved":0,"allocated":19841024,"data_stored":39824195,"data_compressed":2051813,"data_compressed_allocated":19628032,"data_compressed_original":39747584,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42740,"kb_used_data":15916,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94329100,"statfs":{"total":96636764160,"available":96592998400,"internally_reserved":0,"allocated":16297984,"data_stored":32738115,"data_compressed":1686092,"data_compressed_allocated":16084992,"data_compressed_original":32661504,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705718,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43536,"kb_used_data":16712,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94328304,"statfs":{"total":96636764160,"available":96592183296,"internally_reserved":0,"allocated":17113088,"data_stored":33900835,"data_compressed":1746535,"data_compressed_allocated":16920576,"data_compressed_original":33841152,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54016,"kb_used_data":14712,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94317824,"statfs":{"total":96636764160,"available":96581451776,"internally_reserved":0,"allocated":15065088,"data_stored":30272323,"data_compressed":1558789,"data_compressed_allocated":14852096,"data_compressed_original":30195712,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15212544,"data_stored":30425088,"data_compressed":1570276,"data_compressed_allocated":15212544,"data_compressed_original":30425088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17416192,"data_stored":34832384,"data_compressed":1797718,"data_compressed_allocated":17416192,"data_compressed_original":34832384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16449536,"data_stored":32899072,"data_compressed":1698002,"data_compressed_allocated":16449536,"data_compressed_original":32899072,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20135936,"data_stored":40271872,"data_compressed":2078528,"data_compressed_allocated":20135936,"data_compressed_original":40271872,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:40.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:28:40.909816+0000 min lat: 0.0160421 max lat: 0.347001 avg lat: 0.102979 2024-04-25T09:28:40.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:28:40.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 6223 6207 1.21219 1.05469 0.0732216 0.102979 2024-04-25T09:28:41.893 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 6387 6371 1.21387 1.28125 0.0434311 0.102843 2024-04-25T09:28:42.285 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:42.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:42.439+0000 7f46f526d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:42.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:42.445+0000 7f46f526d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:42.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 6559 6543 1.21696 1.34375 0.0790532 0.10259 2024-04-25T09:28:43.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 6726 6710 1.219 1.30469 0.0968392 0.102408 2024-04-25T09:28:44.594 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:44.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:44.752+0000 7febae02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:44.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:44.759+0000 7febae02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:44.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 6879 6863 1.21846 1.19531 0.124991 0.10238 2024-04-25T09:28:45.417 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:45.417 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:45.417 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:28:45.417 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:28:45.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:45.569+0000 7fdc9a86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:45.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:45.580+0000 7fdc9a86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:45.585 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:45.586 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:45.588 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:45.589 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:45.589 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:28:45.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:45.729+0000 7f5a3eaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:45.727 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:45.742+0000 7f5a3eaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:45.751 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:45.752 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:45.752 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:45.754 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:45.755 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:45.755 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:28:45.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 7029 7013 1.21742 1.17188 0.109012 0.102554 2024-04-25T09:28:45.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:45.905+0000 7ff14706d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:45.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:45.921+0000 7ff14706d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:45.943 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:45.943 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:45.943 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:45.943 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:45.944 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:45.948 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:45.949 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:45.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:28:46.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:46.095+0000 7fc0a4e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:46.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:46.113+0000 7fc0a4e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:46.143 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:46.143 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:46.143 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:46.143 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:46.143 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:46.143 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:46.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:46.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:46.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:46.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:46.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:46.144 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:46.147 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:46.147 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:46.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 7186 7170 1.21762 1.22656 0.0880981 0.102493 2024-04-25T09:28:46.984 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:47.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:47.138+0000 7feafae6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:47.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:47.148+0000 7feafae6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:47.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 7344 7328 1.21797 1.23438 0.146522 0.102527 2024-04-25T09:28:48.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 7482 7466 1.21506 1.07812 0.153883 0.102756 2024-04-25T09:28:49.371 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:49.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:49.499+0000 7f687139d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:49.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:49.507+0000 7f687139d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:49.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 7623 7607 1.21274 1.10156 0.0869378 0.102916 2024-04-25T09:28:50.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 7777 7761 1.21254 1.20312 0.12126 0.102963 2024-04-25T09:28:51.148 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:51.148 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:51.149 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:28:51.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:51.275+0000 7fad1de2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:51.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:51.284+0000 7fad1de2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:51.499 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:28:51.499 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:28:51.513 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-25T09:28:51.237357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":59441696,"num_objects":903,"num_object_clones":0,"num_object_copies":2709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7321,"num_write_kb":59366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7265,"ondisk_log_size":7265,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":209212,"kb_used_data":85272,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377278148,"statfs":{"total":386547056640,"available":386332823552,"internally_reserved":0,"allocated":87318528,"data_stored":174738156,"data_compressed":9005526,"data_compressed_allocated":86487040,"data_compressed_original":174448640,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12656640,"num_objects":194,"num_object_clones":0,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002612"},"pg_stats":[{"pgid":"3.f","version":"23'423","reported_seq":449,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:43.983383+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:43.983383+0000","last_peered":"2024-04-25T09:28:43.983383+0000","last_clean":"2024-04-25T09:28:43.983383+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:43.983383+0000","last_undegraded":"2024-04-25T09:28:43.983383+0000","last_fullsized":"2024-04-25T09:28:43.983383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'471","reported_seq":497,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:47.068639+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:47.068639+0000","last_peered":"2024-04-25T09:28:47.068639+0000","last_clean":"2024-04-25T09:28:47.068639+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:47.068639+0000","last_undegraded":"2024-04-25T09:28:47.068639+0000","last_fullsized":"2024-04-25T09:28:47.068639+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'458","reported_seq":484,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:46.381915+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:46.381915+0000","last_peered":"2024-04-25T09:28:46.381915+0000","last_clean":"2024-04-25T09:28:46.381915+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:46.381915+0000","last_undegraded":"2024-04-25T09:28:46.381915+0000","last_fullsized":"2024-04-25T09:28:46.381915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3760128,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":459,"num_write_kb":3672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'391","reported_seq":417,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:46.247934+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:46.247934+0000","last_peered":"2024-04-25T09:28:46.247934+0000","last_clean":"2024-04-25T09:28:46.247934+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:46.247934+0000","last_undegraded":"2024-04-25T09:28:46.247934+0000","last_fullsized":"2024-04-25T09:28:46.247934+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'410","reported_seq":438,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:47.378986+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:47.378986+0000","last_peered":"2024-04-25T09:28:47.378986+0000","last_clean":"2024-04-25T09:28:47.378986+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:47.378986+0000","last_undegraded":"2024-04-25T09:28:47.378986+0000","last_fullsized":"2024-04-25T09:28:47.378986+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3366912,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":3288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'575","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:45.946726+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:45.946726+0000","last_peered":"2024-04-25T09:28:45.946726+0000","last_clean":"2024-04-25T09:28:45.946726+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:45.946726+0000","last_undegraded":"2024-04-25T09:28:45.946726+0000","last_fullsized":"2024-04-25T09:28:45.946726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'359","reported_seq":385,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:43.892660+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:43.892660+0000","last_peered":"2024-04-25T09:28:43.892660+0000","last_clean":"2024-04-25T09:28:43.892660+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:43.892660+0000","last_undegraded":"2024-04-25T09:28:43.892660+0000","last_fullsized":"2024-04-25T09:28:43.892660+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'496","reported_seq":522,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:44.627954+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:44.627954+0000","last_peered":"2024-04-25T09:28:44.627954+0000","last_clean":"2024-04-25T09:28:44.627954+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:44.627954+0000","last_undegraded":"2024-04-25T09:28:44.627954+0000","last_fullsized":"2024-04-25T09:28:44.627954+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4071424,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":3976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'319","reported_seq":345,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:46.348361+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:46.348361+0000","last_peered":"2024-04-25T09:28:46.348361+0000","last_clean":"2024-04-25T09:28:46.348361+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:46.348361+0000","last_undegraded":"2024-04-25T09:28:46.348361+0000","last_fullsized":"2024-04-25T09:28:46.348361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'535","reported_seq":563,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:46.323874+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:46.323874+0000","last_peered":"2024-04-25T09:28:46.323874+0000","last_clean":"2024-04-25T09:28:46.323874+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:46.323874+0000","last_undegraded":"2024-04-25T09:28:46.323874+0000","last_fullsized":"2024-04-25T09:28:46.323874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'527","reported_seq":555,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:47.309636+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:47.309636+0000","last_peered":"2024-04-25T09:28:47.309636+0000","last_clean":"2024-04-25T09:28:47.309636+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:47.309636+0000","last_undegraded":"2024-04-25T09:28:47.309636+0000","last_fullsized":"2024-04-25T09:28:47.309636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'519","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:47.313128+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:47.313128+0000","last_peered":"2024-04-25T09:28:47.313128+0000","last_clean":"2024-04-25T09:28:47.313128+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:47.313128+0000","last_undegraded":"2024-04-25T09:28:47.313128+0000","last_fullsized":"2024-04-25T09:28:47.313128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'399","reported_seq":425,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:46.125482+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:46.125482+0000","last_peered":"2024-04-25T09:28:46.125482+0000","last_clean":"2024-04-25T09:28:46.125482+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:46.125482+0000","last_undegraded":"2024-04-25T09:28:46.125482+0000","last_fullsized":"2024-04-25T09:28:46.125482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'455","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:47.171893+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:47.171893+0000","last_peered":"2024-04-25T09:28:47.171893+0000","last_clean":"2024-04-25T09:28:47.171893+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:47.171893+0000","last_undegraded":"2024-04-25T09:28:47.171893+0000","last_fullsized":"2024-04-25T09:28:47.171893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'335","reported_seq":363,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:46.772693+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:46.772693+0000","last_peered":"2024-04-25T09:28:46.772693+0000","last_clean":"2024-04-25T09:28:46.772693+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:46.772693+0000","last_undegraded":"2024-04-25T09:28:46.772693+0000","last_fullsized":"2024-04-25T09:28:46.772693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'496","reported_seq":522,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:45.989658+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:45.989658+0000","last_peered":"2024-04-25T09:28:45.989658+0000","last_clean":"2024-04-25T09:28:45.989658+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:45.989658+0000","last_undegraded":"2024-04-25T09:28:45.989658+0000","last_fullsized":"2024-04-25T09:28:45.989658+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4071424,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":3976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":58851328,"num_objects":901,"num_object_clones":0,"num_object_copies":2703,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7184,"num_write_kb":57472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88309760,"data_stored":176619520,"data_compressed":9116550,"data_compressed_allocated":88309760,"data_compressed_original":176619520,"omap_allocated":0,"internal_metadata":0},"log_size":7168,"ondisk_log_size":7168,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60068,"kb_used_data":24920,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311772,"statfs":{"total":96636764160,"available":96575254528,"internally_reserved":0,"allocated":25518080,"data_stored":51178307,"data_compressed":2638091,"data_compressed_allocated":25305088,"data_compressed_original":51101696,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51360,"kb_used_data":20376,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94320480,"statfs":{"total":96636764160,"available":96584171520,"internally_reserved":0,"allocated":20865024,"data_stored":41872195,"data_compressed":2157737,"data_compressed_allocated":20652032,"data_compressed_original":41795584,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52196,"kb_used_data":21212,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319644,"statfs":{"total":96636764160,"available":96583315456,"internally_reserved":0,"allocated":21721088,"data_stored":43116835,"data_compressed":2222410,"data_compressed_allocated":21528576,"data_compressed_original":43057152,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45588,"kb_used_data":18764,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94326252,"statfs":{"total":96636764160,"available":96590082048,"internally_reserved":0,"allocated":19214336,"data_stored":38570819,"data_compressed":1987288,"data_compressed_allocated":19001344,"data_compressed_original":38494208,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":19435520,"data_stored":38871040,"data_compressed":2006389,"data_compressed_allocated":19435520,"data_compressed_original":38871040,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21929984,"data_stored":43859968,"data_compressed":2263864,"data_compressed_allocated":21929984,"data_compressed_original":43859968,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21168128,"data_stored":42336256,"data_compressed":2185298,"data_compressed_allocated":21168128,"data_compressed_original":42336256,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25776128,"data_stored":51552256,"data_compressed":2660999,"data_compressed_allocated":25776128,"data_compressed_original":51552256,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:28:51.750 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:51.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:51.897+0000 7f3b7a31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:51.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:51.904+0000 7f3b7a31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:51.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 7918 7902 1.21037 1.10156 0.0359942 0.103132 2024-04-25T09:28:52.894 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 8063 8047 1.20887 1.13281 0.113304 0.103221 2024-04-25T09:28:53.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 8210 8194 1.20773 1.14844 0.157466 0.103321 2024-04-25T09:28:54.073 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:54.194 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:54.207+0000 7faef2024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:54.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:54.213+0000 7faef2024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:54.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 8352 8336 1.20591 1.10938 0.0388595 0.103539 2024-04-25T09:28:55.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 8501 8485 1.20515 1.16406 0.0273074 0.10357 2024-04-25T09:28:56.398 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:28:56.515 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:28:56.515 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:28:56.516 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:28:56.516 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:28:56.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:56.567+0000 7fd8a4ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:56.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:56.574+0000 7fd8a4ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:56.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:56.666+0000 7f662af9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:56.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:56.682+0000 7f662af9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:56.718 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:56.718 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:56.718 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:56.718 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:56.719 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:56.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:56.723 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:56.724 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:28:56.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 8639 8623 1.20288 1.07812 0.0555146 0.103742 2024-04-25T09:28:56.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:56.906+0000 7f60ff99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:56.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:56.916+0000 7f60ff99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:56.927 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:56.928 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:56.928 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:56.930 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:56.930 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:56.930 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:28:57.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:57.067+0000 7fd34e59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:57.062 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:57.077+0000 7fd34e59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:57.079 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:57.079 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:57.079 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:57.079 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:57.079 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:57.079 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:57.080 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:57.080 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:57.080 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:57.080 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:57.080 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:57.080 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:57.082 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:57.083 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:57.083 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:28:57.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:57.241+0000 7fdb54f54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:57.239 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:57.254+0000 7fdb54f54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:57.348 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:28:57.348 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:28:57.348 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:28:57.348 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:28:57.349 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:28:57.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:28:57.351 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:28:57.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 8785 8769 1.20178 1.14062 0.152411 0.103876 2024-04-25T09:28:58.711 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:28:58.842 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:58.855+0000 7fcb46c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:28:58.864+0000 7fcb46c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:28:58.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 8920 8904 1.19925 1.05469 0.190708 0.1041 2024-04-25T09:28:59.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 9068 9052 1.19851 1.15625 0.070503 0.104168 2024-04-25T09:29:00.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:29:00.911585+0000 min lat: 0.0160421 max lat: 0.347001 avg lat: 0.104194 2024-04-25T09:29:00.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:29:00.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 9220 9204 1.19833 1.1875 0.114881 0.104194 2024-04-25T09:29:01.026 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:01.158 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:01.171+0000 7f65c5b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:01.163 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:01.178+0000 7f65c5b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:01.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 9354 9338 1.19584 1.04688 0.0973364 0.104363 2024-04-25T09:29:02.353 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:02.353 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:02.353 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:29:02.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:02.500+0000 7f5131864640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:02.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:02.513+0000 7f5131864640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:02.736 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:29:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:29:02.748 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-25T09:29:01.239745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":71442976,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8786,"num_write_kb":71086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8730,"ondisk_log_size":8730,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":243528,"kb_used_data":102948,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377243832,"statfs":{"total":386547056640,"available":386297683968,"internally_reserved":0,"allocated":105418752,"data_stored":210938604,"data_compressed":10874763,"data_compressed_allocated":104587264,"data_compressed_original":210649088,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12001280,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":11720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002859"},"pg_stats":[{"pgid":"3.f","version":"23'487","reported_seq":513,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:55.576406+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:28:55.576406+0000","last_peered":"2024-04-25T09:28:55.576406+0000","last_clean":"2024-04-25T09:28:55.576406+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:28:55.576406+0000","last_undegraded":"2024-04-25T09:28:55.576406+0000","last_fullsized":"2024-04-25T09:28:55.576406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'559","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:57.297653+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:28:57.297653+0000","last_peered":"2024-04-25T09:28:57.297653+0000","last_clean":"2024-04-25T09:28:57.297653+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:28:57.297653+0000","last_undegraded":"2024-04-25T09:28:57.297653+0000","last_fullsized":"2024-04-25T09:28:57.297653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'519","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:54.689857+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:28:54.689857+0000","last_peered":"2024-04-25T09:28:54.689857+0000","last_clean":"2024-04-25T09:28:54.689857+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:28:54.689857+0000","last_undegraded":"2024-04-25T09:28:54.689857+0000","last_fullsized":"2024-04-25T09:28:54.689857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'455","reported_seq":481,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:53.354411+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:28:53.354411+0000","last_peered":"2024-04-25T09:28:53.354411+0000","last_clean":"2024-04-25T09:28:53.354411+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:28:53.354411+0000","last_undegraded":"2024-04-25T09:28:53.354411+0000","last_fullsized":"2024-04-25T09:28:53.354411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'511","reported_seq":539,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:57.027651+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:28:57.027651+0000","last_peered":"2024-04-25T09:28:57.027651+0000","last_clean":"2024-04-25T09:28:57.027651+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:28:57.027651+0000","last_undegraded":"2024-04-25T09:28:57.027651+0000","last_fullsized":"2024-04-25T09:28:57.027651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'647","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:55.968714+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:28:55.968714+0000","last_peered":"2024-04-25T09:28:55.968714+0000","last_clean":"2024-04-25T09:28:55.968714+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:28:55.968714+0000","last_undegraded":"2024-04-25T09:28:55.968714+0000","last_fullsized":"2024-04-25T09:28:55.968714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'460","reported_seq":486,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:56.393094+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:28:56.393094+0000","last_peered":"2024-04-25T09:28:56.393094+0000","last_clean":"2024-04-25T09:28:56.393094+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:28:56.393094+0000","last_undegraded":"2024-04-25T09:28:56.393094+0000","last_fullsized":"2024-04-25T09:28:56.393094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3776512,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":461,"num_write_kb":3688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'619","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:56.367780+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:28:56.367780+0000","last_peered":"2024-04-25T09:28:56.367780+0000","last_clean":"2024-04-25T09:28:56.367780+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:28:56.367780+0000","last_undegraded":"2024-04-25T09:28:56.367780+0000","last_fullsized":"2024-04-25T09:28:56.367780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5079040,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":620,"num_write_kb":4960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'375","reported_seq":401,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:54.128778+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:28:54.128778+0000","last_peered":"2024-04-25T09:28:54.128778+0000","last_clean":"2024-04-25T09:28:54.128778+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:28:54.128778+0000","last_undegraded":"2024-04-25T09:28:54.128778+0000","last_fullsized":"2024-04-25T09:28:54.128778+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'631","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:56.712924+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:28:56.712924+0000","last_peered":"2024-04-25T09:28:56.712924+0000","last_clean":"2024-04-25T09:28:56.712924+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:28:56.712924+0000","last_undegraded":"2024-04-25T09:28:56.712924+0000","last_fullsized":"2024-04-25T09:28:56.712924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'631","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:57.099847+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:28:57.099847+0000","last_peered":"2024-04-25T09:28:57.099847+0000","last_clean":"2024-04-25T09:28:57.099847+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:28:57.099847+0000","last_undegraded":"2024-04-25T09:28:57.099847+0000","last_fullsized":"2024-04-25T09:28:57.099847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'607","reported_seq":633,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:56.325786+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:28:56.325786+0000","last_peered":"2024-04-25T09:28:56.325786+0000","last_clean":"2024-04-25T09:28:56.325786+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:28:56.325786+0000","last_undegraded":"2024-04-25T09:28:56.325786+0000","last_fullsized":"2024-04-25T09:28:56.325786+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'519","reported_seq":545,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:56.361127+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:28:56.361127+0000","last_peered":"2024-04-25T09:28:56.361127+0000","last_clean":"2024-04-25T09:28:56.361127+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:28:56.361127+0000","last_undegraded":"2024-04-25T09:28:56.361127+0000","last_fullsized":"2024-04-25T09:28:56.361127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'537","reported_seq":563,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:57.376582+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:28:57.376582+0000","last_peered":"2024-04-25T09:28:57.376582+0000","last_clean":"2024-04-25T09:28:57.376582+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:28:57.376582+0000","last_undegraded":"2024-04-25T09:28:57.376582+0000","last_fullsized":"2024-04-25T09:28:57.376582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4407296,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'445","reported_seq":473,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:57.372325+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:28:57.372325+0000","last_peered":"2024-04-25T09:28:57.372325+0000","last_clean":"2024-04-25T09:28:57.372325+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:28:57.372325+0000","last_undegraded":"2024-04-25T09:28:57.372325+0000","last_fullsized":"2024-04-25T09:28:57.372325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653632,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":3568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'631","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:57.149456+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:28:57.149456+0000","last_peered":"2024-04-25T09:28:57.149456+0000","last_clean":"2024-04-25T09:28:57.149456+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:28:57.149456+0000","last_undegraded":"2024-04-25T09:28:57.149456+0000","last_fullsized":"2024-04-25T09:28:57.149456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":70852608,"num_objects":1083,"num_object_clones":0,"num_object_copies":3249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8649,"num_write_kb":69192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106070016,"data_stored":212140032,"data_compressed":10950678,"data_compressed_allocated":106070016,"data_compressed_original":212140032,"omap_allocated":0,"internal_metadata":0},"log_size":8633,"ondisk_log_size":8633,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69396,"kb_used_data":30092,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302444,"statfs":{"total":96636764160,"available":96565702656,"internally_reserved":0,"allocated":30814208,"data_stored":61770563,"data_compressed":3185030,"data_compressed_allocated":30601216,"data_compressed_original":61693952,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59916,"kb_used_data":24772,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311924,"statfs":{"total":96636764160,"available":96575410176,"internally_reserved":0,"allocated":25366528,"data_stored":50875203,"data_compressed":2622614,"data_compressed_allocated":25153536,"data_compressed_original":50798592,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60816,"kb_used_data":25672,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311024,"statfs":{"total":96636764160,"available":96574488576,"internally_reserved":0,"allocated":26288128,"data_stored":52250915,"data_compressed":2694055,"data_compressed_allocated":26095616,"data_compressed_original":52191232,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53400,"kb_used_data":22412,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318440,"statfs":{"total":96636764160,"available":96582082560,"internally_reserved":0,"allocated":22949888,"data_stored":46041923,"data_compressed":2373064,"data_compressed_allocated":22736896,"data_compressed_original":45965312,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23035904,"data_stored":46071808,"data_compressed":2378206,"data_compressed_allocated":23035904,"data_compressed_original":46071808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26550272,"data_stored":53100544,"data_compressed":2741008,"data_compressed_allocated":26550272,"data_compressed_original":53100544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25468928,"data_stored":50937856,"data_compressed":2629448,"data_compressed_allocated":25468928,"data_compressed_original":50937856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31014912,"data_stored":62029824,"data_compressed":3202016,"data_compressed_allocated":31014912,"data_compressed_original":62029824,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:29:02.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 9505 9489 1.19558 1.17969 0.180858 0.104456 2024-04-25T09:29:03.304 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:03.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:03.442+0000 7fdde8cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:03.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:03.449+0000 7fdde8cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:03.895 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 9648 9632 1.19433 1.11719 0.10285 0.104577 2024-04-25T09:29:04.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 9794 9778 1.19349 1.14062 0.1637 0.10461 2024-04-25T09:29:05.665 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:05.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:05.803+0000 7f6b06b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:05.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:05.809+0000 7f6b06b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:05.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 9936 9920 1.1922 1.10938 0.103013 0.104684 2024-04-25T09:29:06.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 10076 10060 1.19071 1.09375 0.124767 0.104866 2024-04-25T09:29:07.750 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:07.751 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:07.751 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:29:07.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 10223 10207 1.19007 1.14844 0.0771085 0.104942 2024-04-25T09:29:07.903 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:07.914+0000 7ff2b982d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:07.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:07.926+0000 7ff2b982d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:08.044 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:08.183 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:29:08.183 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:29:08.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:08.197+0000 7f6199e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:08.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:08.206+0000 7f6199e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:08.201 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T09:29:07.240986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79995424,"num_objects":1215,"num_object_clones":0,"num_object_copies":3645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9830,"num_write_kb":79438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9774,"ondisk_log_size":9774,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":252264,"kb_used_data":115848,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377235096,"statfs":{"total":386547056640,"available":386288738304,"internally_reserved":0,"allocated":118628352,"data_stored":237357804,"data_compressed":12238938,"data_compressed_allocated":117796864,"data_compressed_original":237068288,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14688256,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1793,"num_write_kb":14344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"3.f","version":"23'543","reported_seq":569,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:03.937107+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:29:03.937107+0000","last_peered":"2024-04-25T09:29:03.937107+0000","last_clean":"2024-04-25T09:29:03.937107+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:29:03.937107+0000","last_undegraded":"2024-04-25T09:29:03.937107+0000","last_fullsized":"2024-04-25T09:29:03.937107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'623","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:01.938119+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:29:01.938119+0000","last_peered":"2024-04-25T09:29:01.938119+0000","last_clean":"2024-04-25T09:29:01.938119+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:29:01.938119+0000","last_undegraded":"2024-04-25T09:29:01.938119+0000","last_fullsized":"2024-04-25T09:29:01.938119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'615","reported_seq":641,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:06.078318+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:29:06.078318+0000","last_peered":"2024-04-25T09:29:06.078318+0000","last_clean":"2024-04-25T09:29:06.078318+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:29:06.078318+0000","last_undegraded":"2024-04-25T09:29:06.078318+0000","last_fullsized":"2024-04-25T09:29:06.078318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'544","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:05.190288+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:29:05.190288+0000","last_peered":"2024-04-25T09:29:05.190288+0000","last_clean":"2024-04-25T09:29:05.190288+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:29:05.190288+0000","last_undegraded":"2024-04-25T09:29:05.190288+0000","last_fullsized":"2024-04-25T09:29:05.190288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4464640,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":4360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'535","reported_seq":563,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:00.826339+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:29:00.826339+0000","last_peered":"2024-04-25T09:29:00.826339+0000","last_clean":"2024-04-25T09:29:00.826339+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:29:00.826339+0000","last_undegraded":"2024-04-25T09:29:00.826339+0000","last_fullsized":"2024-04-25T09:29:00.826339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'791","reported_seq":817,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:05.268572+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:29:05.268572+0000","last_peered":"2024-04-25T09:29:05.268572+0000","last_clean":"2024-04-25T09:29:05.268572+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:29:05.268572+0000","last_undegraded":"2024-04-25T09:29:05.268572+0000","last_fullsized":"2024-04-25T09:29:05.268572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'542","reported_seq":568,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:06.401706+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:29:06.401706+0000","last_peered":"2024-04-25T09:29:06.401706+0000","last_clean":"2024-04-25T09:29:06.401706+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:29:06.401706+0000","last_undegraded":"2024-04-25T09:29:06.401706+0000","last_fullsized":"2024-04-25T09:29:06.401706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4448256,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":4344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'703","reported_seq":729,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:06.166298+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:29:06.166298+0000","last_peered":"2024-04-25T09:29:06.166298+0000","last_clean":"2024-04-25T09:29:06.166298+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:29:06.166298+0000","last_undegraded":"2024-04-25T09:29:06.166298+0000","last_fullsized":"2024-04-25T09:29:06.166298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'447","reported_seq":473,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:05.721982+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:29:05.721982+0000","last_peered":"2024-04-25T09:29:05.721982+0000","last_clean":"2024-04-25T09:29:05.721982+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:29:05.721982+0000","last_undegraded":"2024-04-25T09:29:05.721982+0000","last_fullsized":"2024-04-25T09:29:05.721982+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'663","reported_seq":691,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:01.984719+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:29:01.984719+0000","last_peered":"2024-04-25T09:29:01.984719+0000","last_clean":"2024-04-25T09:29:01.984719+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:29:01.984719+0000","last_undegraded":"2024-04-25T09:29:01.984719+0000","last_fullsized":"2024-04-25T09:29:01.984719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'679","reported_seq":707,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:02.119437+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:29:02.119437+0000","last_peered":"2024-04-25T09:29:02.119437+0000","last_clean":"2024-04-25T09:29:02.119437+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:29:02.119437+0000","last_undegraded":"2024-04-25T09:29:02.119437+0000","last_fullsized":"2024-04-25T09:29:02.119437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'639","reported_seq":665,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:01.008811+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:29:01.008811+0000","last_peered":"2024-04-25T09:29:01.008811+0000","last_clean":"2024-04-25T09:29:01.008811+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:29:01.008811+0000","last_undegraded":"2024-04-25T09:29:01.008811+0000","last_fullsized":"2024-04-25T09:29:01.008811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'559","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:06.350321+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:29:06.350321+0000","last_peered":"2024-04-25T09:29:06.350321+0000","last_clean":"2024-04-25T09:29:06.350321+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:29:06.350321+0000","last_undegraded":"2024-04-25T09:29:06.350321+0000","last_fullsized":"2024-04-25T09:29:06.350321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'599","reported_seq":625,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:02.142812+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:29:02.142812+0000","last_peered":"2024-04-25T09:29:02.142812+0000","last_clean":"2024-04-25T09:29:02.142812+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:29:02.142812+0000","last_undegraded":"2024-04-25T09:29:02.142812+0000","last_fullsized":"2024-04-25T09:29:02.142812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'524","reported_seq":552,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:02.391935+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:29:02.391935+0000","last_peered":"2024-04-25T09:29:02.391935+0000","last_clean":"2024-04-25T09:29:02.391935+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:29:02.391935+0000","last_undegraded":"2024-04-25T09:29:02.391935+0000","last_fullsized":"2024-04-25T09:29:02.391935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4300800,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'671","reported_seq":697,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:02.257649+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:29:02.257649+0000","last_peered":"2024-04-25T09:29:02.257649+0000","last_clean":"2024-04-25T09:29:02.257649+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:29:02.257649+0000","last_undegraded":"2024-04-25T09:29:02.257649+0000","last_fullsized":"2024-04-25T09:29:02.257649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":79405056,"num_objects":1213,"num_object_clones":0,"num_object_copies":3639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9693,"num_write_kb":77544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119320576,"data_stored":238641152,"data_compressed":12319083,"data_compressed_allocated":119320576,"data_compressed_original":238641152,"omap_allocated":0,"internal_metadata":0},"log_size":9677,"ondisk_log_size":9677,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59300,"kb_used_data":32476,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94312540,"statfs":{"total":96636764160,"available":96576040960,"internally_reserved":0,"allocated":33255424,"data_stored":66652995,"data_compressed":3437138,"data_compressed_allocated":33042432,"data_compressed_original":66576384,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673039,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61968,"kb_used_data":26824,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94309872,"statfs":{"total":96636764160,"available":96573308928,"internally_reserved":0,"allocated":27467776,"data_stored":55077699,"data_compressed":2839613,"data_compressed_allocated":27254784,"data_compressed_original":55001088,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69376,"kb_used_data":30072,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302464,"statfs":{"total":96636764160,"available":96565723136,"internally_reserved":0,"allocated":30793728,"data_stored":61262115,"data_compressed":3159355,"data_compressed_allocated":30601216,"data_compressed_original":61202432,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61620,"kb_used_data":26476,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94310220,"statfs":{"total":96636764160,"available":96573665280,"internally_reserved":0,"allocated":27111424,"data_stored":54364995,"data_compressed":2802832,"data_compressed_allocated":26898432,"data_compressed_original":54288384,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27267072,"data_stored":54534144,"data_compressed":2815165,"data_compressed_allocated":27267072,"data_compressed_original":54534144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30961664,"data_stored":61923328,"data_compressed":3196579,"data_compressed_allocated":30961664,"data_compressed_original":61923328,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27590656,"data_stored":55181312,"data_compressed":2848562,"data_compressed_allocated":27590656,"data_compressed_original":55181312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33501184,"data_stored":67002368,"data_compressed":3458777,"data_compressed_allocated":33501184,"data_compressed_original":67002368,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:29:08.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 10355 10339 1.18774 1.03125 0.155211 0.105115 2024-04-25T09:29:09.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 10485 10469 1.18524 1.01562 0.104162 0.105347 2024-04-25T09:29:10.348 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:10.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:10.489+0000 7f9e316ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:10.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:10.497+0000 7f9e316ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:10.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 10633 10617 1.18483 1.15625 0.112265 0.10541 2024-04-25T09:29:11.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 10780 10764 1.18431 1.14844 0.236676 0.105459 2024-04-25T09:29:12.641 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:12.772 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:12.784+0000 7fe182064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:12.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:12.791+0000 7fe182064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:12.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 10921 10905 1.18316 1.10156 0.144428 0.105519 2024-04-25T09:29:13.204 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:13.204 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:13.204 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:29:13.204 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:29:13.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.374+0000 7f0e0239d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:13.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.390+0000 7f0e0239d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:13.404 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:13.405 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:13.406 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:13.408 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:13.409 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:13.409 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:29:13.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.572+0000 7fa526aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:13.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.587+0000 7fa526aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:13.594 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:13.597 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:13.598 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:13.598 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:29:13.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.757+0000 7f91b0a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:13.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.770+0000 7f91b0a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:13.778 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:13.778 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:13.778 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:13.778 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:13.778 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:13.779 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:13.779 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:13.779 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:13.779 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:13.779 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:13.779 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:13.779 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:13.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:13.784 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:13.785 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:29:13.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 11060 11044 1.18183 1.08594 0.0644055 0.105679 2024-04-25T09:29:13.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.932+0000 7fb95f39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:13.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:13.943+0000 7fb95f39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:14.015 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:14.016 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:14.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:14.020 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:14.896 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 11201 11185 1.18074 1.10156 0.0885722 0.105766 2024-04-25T09:29:14.971 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:15.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:15.130+0000 7f9d09024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:15.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:15.138+0000 7f9d09024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:15.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 11357 11341 1.18125 1.21875 0.128809 0.105716 2024-04-25T09:29:16.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 11503 11487 1.18071 1.14062 0.152471 0.105784 2024-04-25T09:29:17.310 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:17.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:17.467+0000 7f6dc666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:17.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:17.473+0000 7f6dc666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:17.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 11647 11631 1.17999 1.125 0.124205 0.105832 2024-04-25T09:29:18.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 11797 11781 1.17988 1.17188 0.0987307 0.105854 2024-04-25T09:29:19.021 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:19.022 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:19.022 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:29:19.022 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:29:19.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.185+0000 7fae22cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.201+0000 7fae22cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:19.207 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:19.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:19.212 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:19.212 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:29:19.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.380+0000 7f836e39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.394+0000 7f836e39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:19.415 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:19.416 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:19.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:19.419 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:19.419 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:29:19.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.562+0000 7f68484ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.578+0000 7f68484ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:19.585 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:19.589 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:19.589 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:19.589 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:29:19.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:19.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.745+0000 7f0b7d354640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.745 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.760+0000 7f0b7d354640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.801+0000 7f8dc6f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.796 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:19.810+0000 7f8dc6f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:19.848 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:19.848 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:19.849 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:19.853 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:19.853 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:19.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 11937 11921 1.17879 1.09375 0.109419 0.105958 2024-04-25T09:29:20.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:29:20.913370+0000 min lat: 0.0160421 max lat: 0.350384 avg lat: 0.106086 2024-04-25T09:29:20.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:29:20.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 16 12067 12051 1.17675 1.01562 0.0966602 0.106086 2024-04-25T09:29:21.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 12196 12180 1.17466 1.00781 0.136051 0.106187 2024-04-25T09:29:21.947 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:22.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:22.102+0000 7f2c5186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:22.094 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:22.109+0000 7f2c5186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:22.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 12326 12310 1.17272 1.01562 0.108049 0.106484 2024-04-25T09:29:23.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 16 12457 12441 1.17092 1.02344 0.119236 0.106666 2024-04-25T09:29:24.271 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:24.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:24.432+0000 7f5f2f46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:24.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:24.442+0000 7f5f2f46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:24.854 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:24.854 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:24.854 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:29:24.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 12573 12557 1.16777 0.90625 0.170847 0.10694 2024-04-25T09:29:24.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:24.993+0000 7f36f639d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:24.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:25.002+0000 7f36f639d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:25.269 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:29:25.269 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:29:25.284 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-04-25T09:29:25.245129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":100483616,"num_objects":1527,"num_object_clones":0,"num_object_copies":4581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":12331,"num_write_kb":99446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12275,"ondisk_log_size":12275,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":265656,"kb_used_data":145876,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":377221704,"statfs":{"total":386547056640,"available":386275024896,"internally_reserved":0,"allocated":149377024,"data_stored":298855148,"data_compressed":15414396,"data_compressed_allocated":148545536,"data_compressed_original":298565632,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11829248,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1444,"num_write_kb":11552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002898"},"pg_stats":[{"pgid":"3.f","version":"23'695","reported_seq":721,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:20.485714+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:29:20.485714+0000","last_peered":"2024-04-25T09:29:20.485714+0000","last_clean":"2024-04-25T09:29:20.485714+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:29:20.485714+0000","last_undegraded":"2024-04-25T09:29:20.485714+0000","last_fullsized":"2024-04-25T09:29:20.485714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'771","reported_seq":797,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:22.383577+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:29:22.383577+0000","last_peered":"2024-04-25T09:29:22.383577+0000","last_clean":"2024-04-25T09:29:22.383577+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:29:22.383577+0000","last_undegraded":"2024-04-25T09:29:22.383577+0000","last_fullsized":"2024-04-25T09:29:22.383577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324224,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":6176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'799","reported_seq":825,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:21.032453+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:29:21.032453+0000","last_peered":"2024-04-25T09:29:21.032453+0000","last_clean":"2024-04-25T09:29:21.032453+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:29:21.032453+0000","last_undegraded":"2024-04-25T09:29:21.032453+0000","last_fullsized":"2024-04-25T09:29:21.032453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'663","reported_seq":689,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:20.427748+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:29:20.427748+0000","last_peered":"2024-04-25T09:29:20.427748+0000","last_clean":"2024-04-25T09:29:20.427748+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:29:20.427748+0000","last_undegraded":"2024-04-25T09:29:20.427748+0000","last_fullsized":"2024-04-25T09:29:20.427748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'679","reported_seq":707,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:21.536973+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:29:21.536973+0000","last_peered":"2024-04-25T09:29:21.536973+0000","last_clean":"2024-04-25T09:29:21.536973+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:29:21.536973+0000","last_undegraded":"2024-04-25T09:29:21.536973+0000","last_fullsized":"2024-04-25T09:29:21.536973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'951","reported_seq":977,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:19.982847+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:29:19.982847+0000","last_peered":"2024-04-25T09:29:19.982847+0000","last_clean":"2024-04-25T09:29:19.982847+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:29:19.982847+0000","last_undegraded":"2024-04-25T09:29:19.982847+0000","last_fullsized":"2024-04-25T09:29:19.982847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":952,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'687","reported_seq":713,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:21.352545+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:29:21.352545+0000","last_peered":"2024-04-25T09:29:21.352545+0000","last_clean":"2024-04-25T09:29:21.352545+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:29:21.352545+0000","last_undegraded":"2024-04-25T09:29:21.352545+0000","last_fullsized":"2024-04-25T09:29:21.352545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'863","reported_seq":889,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:20.575865+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:29:20.575865+0000","last_peered":"2024-04-25T09:29:20.575865+0000","last_clean":"2024-04-25T09:29:20.575865+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:29:20.575865+0000","last_undegraded":"2024-04-25T09:29:20.575865+0000","last_fullsized":"2024-04-25T09:29:20.575865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'591","reported_seq":617,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:21.173648+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:29:21.173648+0000","last_peered":"2024-04-25T09:29:21.173648+0000","last_clean":"2024-04-25T09:29:21.173648+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:29:21.173648+0000","last_undegraded":"2024-04-25T09:29:21.173648+0000","last_fullsized":"2024-04-25T09:29:21.173648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'847","reported_seq":875,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:22.282093+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:29:22.282093+0000","last_peered":"2024-04-25T09:29:22.282093+0000","last_clean":"2024-04-25T09:29:22.282093+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:29:22.282093+0000","last_undegraded":"2024-04-25T09:29:22.282093+0000","last_fullsized":"2024-04-25T09:29:22.282093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'823","reported_seq":851,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:22.047838+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:29:22.047838+0000","last_peered":"2024-04-25T09:29:22.047838+0000","last_clean":"2024-04-25T09:29:22.047838+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:29:22.047838+0000","last_undegraded":"2024-04-25T09:29:22.047838+0000","last_fullsized":"2024-04-25T09:29:22.047838+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'791","reported_seq":817,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:22.133988+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:29:22.133988+0000","last_peered":"2024-04-25T09:29:22.133988+0000","last_clean":"2024-04-25T09:29:22.133988+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:29:22.133988+0000","last_undegraded":"2024-04-25T09:29:22.133988+0000","last_fullsized":"2024-04-25T09:29:22.133988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'725","reported_seq":751,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:21.396627+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:29:21.396627+0000","last_peered":"2024-04-25T09:29:21.396627+0000","last_clean":"2024-04-25T09:29:21.396627+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:29:21.396627+0000","last_undegraded":"2024-04-25T09:29:21.396627+0000","last_fullsized":"2024-04-25T09:29:21.396627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5947392,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":5808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'751","reported_seq":777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:21.192678+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:29:21.192678+0000","last_peered":"2024-04-25T09:29:21.192678+0000","last_clean":"2024-04-25T09:29:21.192678+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:29:21.192678+0000","last_undegraded":"2024-04-25T09:29:21.192678+0000","last_fullsized":"2024-04-25T09:29:21.192678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'711","reported_seq":739,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:21.655270+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:29:21.655270+0000","last_peered":"2024-04-25T09:29:21.655270+0000","last_clean":"2024-04-25T09:29:21.655270+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:29:21.655270+0000","last_undegraded":"2024-04-25T09:29:21.655270+0000","last_fullsized":"2024-04-25T09:29:21.655270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'831","reported_seq":857,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:20.863750+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:29:20.863750+0000","last_peered":"2024-04-25T09:29:20.863750+0000","last_clean":"2024-04-25T09:29:20.863750+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:29:20.863750+0000","last_undegraded":"2024-04-25T09:29:20.863750+0000","last_fullsized":"2024-04-25T09:29:20.863750+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":99893248,"num_objects":1525,"num_object_clones":0,"num_object_copies":4575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12194,"num_write_kb":97552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149716992,"data_stored":299433984,"data_compressed":15458163,"data_compressed_allocated":149716992,"data_compressed_original":299433984,"omap_allocated":0,"internal_metadata":0},"log_size":12178,"ondisk_log_size":12178,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673059,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77404,"kb_used_data":42256,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94294436,"statfs":{"total":96636764160,"available":96557502464,"internally_reserved":0,"allocated":43270144,"data_stored":86682435,"data_compressed":4471372,"data_compressed_allocated":43057152,"data_compressed_original":86605824,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673059,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61088,"kb_used_data":34264,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94310752,"statfs":{"total":96636764160,"available":96574210048,"internally_reserved":0,"allocated":35086336,"data_stored":70314819,"data_compressed":3626392,"data_compressed_allocated":34873344,"data_compressed_original":70238208,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67828,"kb_used_data":36844,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94304012,"statfs":{"total":96636764160,"available":96567308288,"internally_reserved":0,"allocated":37728256,"data_stored":75131171,"data_compressed":3875494,"data_compressed_allocated":37535744,"data_compressed_original":75071488,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705763,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59336,"kb_used_data":32512,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94312504,"statfs":{"total":96636764160,"available":96576004096,"internally_reserved":0,"allocated":33292288,"data_stored":66726723,"data_compressed":3441138,"data_compressed_allocated":33079296,"data_compressed_original":66650112,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33341440,"data_stored":66682880,"data_compressed":3442473,"data_compressed_allocated":33341440,"data_compressed_original":66682880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37937152,"data_stored":75874304,"data_compressed":3916948,"data_compressed_allocated":37937152,"data_compressed_original":75874304,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35110912,"data_stored":70221824,"data_compressed":3625189,"data_compressed_allocated":35110912,"data_compressed_original":70221824,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43327488,"data_stored":86654976,"data_compressed":4473553,"data_compressed_allocated":43327488,"data_compressed_original":86654976,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:29:25.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 12705 12689 1.16616 1.03125 0.0950019 0.107059 2024-04-25T09:29:26.563 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:26.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:26.749+0000 7f875559d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:26.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:26.756+0000 7f875559d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:26.897 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 12838 12822 1.16468 1.03906 0.0831834 0.107213 2024-04-25T09:29:27.898 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 12975 12959 1.1636 1.07031 0.168849 0.107335 2024-04-25T09:29:28.898 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 13097 13081 1.1612 0.953125 0.0922646 0.107558 2024-04-25T09:29:28.911 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:29.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:29.053+0000 7f811b06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:29.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:29.061+0000 7f811b06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:29.898 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 13228 13212 1.15966 1.02344 0.0803974 0.107684 2024-04-25T09:29:30.286 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:30.287 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:30.287 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:29:30.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:30.419+0000 7f68c619d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:30.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:30.428+0000 7f68c619d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:30.665 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:29:30.666 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:29:30.687 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-25T09:29:29.245986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105423392,"num_objects":1602,"num_object_clones":0,"num_object_copies":4806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":12934,"num_write_kb":104270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12878,"ondisk_log_size":12878,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":281448,"kb_used_data":153352,"kb_used_omap":0,"kb_used_meta":128064,"kb_avail":377205912,"statfs":{"total":386547056640,"available":386258853888,"internally_reserved":0,"allocated":157032448,"data_stored":314165996,"data_compressed":16204983,"data_compressed_allocated":156200960,"data_compressed_original":313876480,"omap_allocated":0,"internal_metadata":131137536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13475840,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1645,"num_write_kb":13160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002742"},"pg_stats":[{"pgid":"3.f","version":"23'743","reported_seq":769,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:26.288053+0000","last_change":"2024-04-25T09:28:00.036169+0000","last_active":"2024-04-25T09:29:26.288053+0000","last_peered":"2024-04-25T09:29:26.288053+0000","last_clean":"2024-04-25T09:29:26.288053+0000","last_became_active":"2024-04-25T09:28:00.029572+0000","last_became_peered":"2024-04-25T09:28:00.029572+0000","last_unstale":"2024-04-25T09:29:26.288053+0000","last_undegraded":"2024-04-25T09:29:26.288053+0000","last_fullsized":"2024-04-25T09:29:26.288053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"23'807","reported_seq":833,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:26.531559+0000","last_change":"2024-04-25T09:27:59.962787+0000","last_active":"2024-04-25T09:29:26.531559+0000","last_peered":"2024-04-25T09:29:26.531559+0000","last_clean":"2024-04-25T09:29:26.531559+0000","last_became_active":"2024-04-25T09:27:59.957130+0000","last_became_peered":"2024-04-25T09:27:59.957130+0000","last_unstale":"2024-04-25T09:29:26.531559+0000","last_undegraded":"2024-04-25T09:29:26.531559+0000","last_fullsized":"2024-04-25T09:29:26.531559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'852","reported_seq":878,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:26.394402+0000","last_change":"2024-04-25T09:28:00.029143+0000","last_active":"2024-04-25T09:29:26.394402+0000","last_peered":"2024-04-25T09:29:26.394402+0000","last_clean":"2024-04-25T09:29:26.394402+0000","last_became_active":"2024-04-25T09:28:00.023757+0000","last_became_peered":"2024-04-25T09:28:00.023757+0000","last_unstale":"2024-04-25T09:29:26.394402+0000","last_undegraded":"2024-04-25T09:29:26.394402+0000","last_fullsized":"2024-04-25T09:29:26.394402+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6987776,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":6824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'703","reported_seq":729,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:25.582515+0000","last_change":"2024-04-25T09:27:59.995365+0000","last_active":"2024-04-25T09:29:25.582515+0000","last_peered":"2024-04-25T09:29:25.582515+0000","last_clean":"2024-04-25T09:29:25.582515+0000","last_became_active":"2024-04-25T09:27:59.985229+0000","last_became_peered":"2024-04-25T09:27:59.985229+0000","last_unstale":"2024-04-25T09:29:25.582515+0000","last_undegraded":"2024-04-25T09:29:25.582515+0000","last_fullsized":"2024-04-25T09:29:25.582515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'735","reported_seq":763,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:27.170366+0000","last_change":"2024-04-25T09:27:59.975487+0000","last_active":"2024-04-25T09:29:27.170366+0000","last_peered":"2024-04-25T09:29:27.170366+0000","last_clean":"2024-04-25T09:29:27.170366+0000","last_became_active":"2024-04-25T09:27:59.967456+0000","last_became_peered":"2024-04-25T09:27:59.967456+0000","last_unstale":"2024-04-25T09:29:27.170366+0000","last_undegraded":"2024-04-25T09:29:27.170366+0000","last_fullsized":"2024-04-25T09:29:27.170366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'991","reported_seq":1017,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:24.589464+0000","last_change":"2024-04-25T09:28:00.019682+0000","last_active":"2024-04-25T09:29:24.589464+0000","last_peered":"2024-04-25T09:29:24.589464+0000","last_clean":"2024-04-25T09:29:24.589464+0000","last_became_active":"2024-04-25T09:28:00.013834+0000","last_became_peered":"2024-04-25T09:28:00.013834+0000","last_unstale":"2024-04-25T09:29:24.589464+0000","last_undegraded":"2024-04-25T09:29:24.589464+0000","last_fullsized":"2024-04-25T09:29:24.589464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":992,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"23'751","reported_seq":777,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:26.004775+0000","last_change":"2024-04-25T09:27:59.991524+0000","last_active":"2024-04-25T09:29:26.004775+0000","last_peered":"2024-04-25T09:29:26.004775+0000","last_clean":"2024-04-25T09:29:26.004775+0000","last_became_active":"2024-04-25T09:27:59.978348+0000","last_became_peered":"2024-04-25T09:27:59.978348+0000","last_unstale":"2024-04-25T09:29:26.004775+0000","last_undegraded":"2024-04-25T09:29:26.004775+0000","last_fullsized":"2024-04-25T09:29:26.004775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"23'871","reported_seq":897,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:23.204738+0000","last_change":"2024-04-25T09:27:59.975726+0000","last_active":"2024-04-25T09:29:23.204738+0000","last_peered":"2024-04-25T09:29:23.204738+0000","last_clean":"2024-04-25T09:29:23.204738+0000","last_became_active":"2024-04-25T09:27:59.969035+0000","last_became_peered":"2024-04-25T09:27:59.969035+0000","last_unstale":"2024-04-25T09:29:23.204738+0000","last_undegraded":"2024-04-25T09:29:23.204738+0000","last_fullsized":"2024-04-25T09:29:23.204738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338729+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:28:17.338729+0000","last_peered":"2024-04-25T09:28:17.338729+0000","last_clean":"2024-04-25T09:28:17.338729+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:28:17.338729+0000","last_undegraded":"2024-04-25T09:28:17.338729+0000","last_fullsized":"2024-04-25T09:28:17.338729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.459126+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:28:17.459126+0000","last_peered":"2024-04-25T09:28:17.459126+0000","last_clean":"2024-04-25T09:28:17.459126+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:28:17.459126+0000","last_undegraded":"2024-04-25T09:28:17.459126+0000","last_fullsized":"2024-04-25T09:28:17.459126+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"23'623","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:26.294161+0000","last_change":"2024-04-25T09:28:00.063381+0000","last_active":"2024-04-25T09:29:26.294161+0000","last_peered":"2024-04-25T09:29:26.294161+0000","last_clean":"2024-04-25T09:29:26.294161+0000","last_became_active":"2024-04-25T09:28:00.055686+0000","last_became_peered":"2024-04-25T09:28:00.055686+0000","last_unstale":"2024-04-25T09:29:26.294161+0000","last_undegraded":"2024-04-25T09:29:26.294161+0000","last_fullsized":"2024-04-25T09:29:26.294161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.472289+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:28:17.472289+0000","last_peered":"2024-04-25T09:28:17.472289+0000","last_clean":"2024-04-25T09:28:17.472289+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:28:17.472289+0000","last_undegraded":"2024-04-25T09:28:17.472289+0000","last_fullsized":"2024-04-25T09:28:17.472289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"23'895","reported_seq":923,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:27.250580+0000","last_change":"2024-04-25T09:27:59.996636+0000","last_active":"2024-04-25T09:29:27.250580+0000","last_peered":"2024-04-25T09:29:27.250580+0000","last_clean":"2024-04-25T09:29:27.250580+0000","last_became_active":"2024-04-25T09:27:59.985987+0000","last_became_peered":"2024-04-25T09:27:59.985987+0000","last_unstale":"2024-04-25T09:29:27.250580+0000","last_undegraded":"2024-04-25T09:29:27.250580+0000","last_fullsized":"2024-04-25T09:29:27.250580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.438824+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:28:17.438824+0000","last_peered":"2024-04-25T09:28:17.438824+0000","last_clean":"2024-04-25T09:28:17.438824+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:28:17.438824+0000","last_undegraded":"2024-04-25T09:28:17.438824+0000","last_fullsized":"2024-04-25T09:28:17.438824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"23'863","reported_seq":891,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:25.917257+0000","last_change":"2024-04-25T09:28:00.045683+0000","last_active":"2024-04-25T09:29:25.917257+0000","last_peered":"2024-04-25T09:29:25.917257+0000","last_clean":"2024-04-25T09:29:25.917257+0000","last_became_active":"2024-04-25T09:28:00.041159+0000","last_became_peered":"2024-04-25T09:28:00.041159+0000","last_unstale":"2024-04-25T09:29:25.917257+0000","last_undegraded":"2024-04-25T09:29:25.917257+0000","last_fullsized":"2024-04-25T09:29:25.917257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.456560+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:28:17.456560+0000","last_peered":"2024-04-25T09:28:17.456560+0000","last_clean":"2024-04-25T09:28:17.456560+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:28:17.456560+0000","last_undegraded":"2024-04-25T09:28:17.456560+0000","last_fullsized":"2024-04-25T09:28:17.456560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"23'815","reported_seq":841,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:27.376457+0000","last_change":"2024-04-25T09:27:59.971415+0000","last_active":"2024-04-25T09:29:27.376457+0000","last_peered":"2024-04-25T09:29:27.376457+0000","last_clean":"2024-04-25T09:29:27.376457+0000","last_became_active":"2024-04-25T09:27:59.965738+0000","last_became_peered":"2024-04-25T09:27:59.965738+0000","last_unstale":"2024-04-25T09:29:27.376457+0000","last_undegraded":"2024-04-25T09:29:27.376457+0000","last_fullsized":"2024-04-25T09:29:27.376457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"23'759","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:25.311173+0000","last_change":"2024-04-25T09:28:00.008626+0000","last_active":"2024-04-25T09:29:25.311173+0000","last_peered":"2024-04-25T09:29:25.311173+0000","last_clean":"2024-04-25T09:29:25.311173+0000","last_became_active":"2024-04-25T09:28:00.001657+0000","last_became_peered":"2024-04-25T09:28:00.001657+0000","last_unstale":"2024-04-25T09:29:25.311173+0000","last_undegraded":"2024-04-25T09:29:25.311173+0000","last_fullsized":"2024-04-25T09:29:25.311173+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.426738+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:28:17.426738+0000","last_peered":"2024-04-25T09:28:17.426738+0000","last_clean":"2024-04-25T09:28:17.426738+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:28:17.426738+0000","last_undegraded":"2024-04-25T09:28:17.426738+0000","last_fullsized":"2024-04-25T09:28:17.426738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"23'759","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:25.024338+0000","last_change":"2024-04-25T09:28:00.005752+0000","last_active":"2024-04-25T09:29:25.024338+0000","last_peered":"2024-04-25T09:29:25.024338+0000","last_clean":"2024-04-25T09:29:25.024338+0000","last_became_active":"2024-04-25T09:27:59.999180+0000","last_became_peered":"2024-04-25T09:27:59.999180+0000","last_unstale":"2024-04-25T09:29:25.024338+0000","last_undegraded":"2024-04-25T09:29:25.024338+0000","last_fullsized":"2024-04-25T09:29:25.024338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.338849+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:28:17.338849+0000","last_peered":"2024-04-25T09:28:17.338849+0000","last_clean":"2024-04-25T09:28:17.338849+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:28:17.338849+0000","last_undegraded":"2024-04-25T09:28:17.338849+0000","last_fullsized":"2024-04-25T09:28:17.338849+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'759","reported_seq":787,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:26.080644+0000","last_change":"2024-04-25T09:28:00.042416+0000","last_active":"2024-04-25T09:29:26.080644+0000","last_peered":"2024-04-25T09:29:26.080644+0000","last_clean":"2024-04-25T09:29:26.080644+0000","last_became_active":"2024-04-25T09:28:00.035476+0000","last_became_peered":"2024-04-25T09:28:00.035476+0000","last_unstale":"2024-04-25T09:29:26.080644+0000","last_undegraded":"2024-04-25T09:29:26.080644+0000","last_fullsized":"2024-04-25T09:29:26.080644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.431584+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:28:17.431584+0000","last_peered":"2024-04-25T09:28:17.431584+0000","last_clean":"2024-04-25T09:28:17.431584+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:28:17.431584+0000","last_undegraded":"2024-04-25T09:28:17.431584+0000","last_fullsized":"2024-04-25T09:28:17.431584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"23'855","reported_seq":881,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:29:24.264368+0000","last_change":"2024-04-25T09:28:00.016955+0000","last_active":"2024-04-25T09:29:24.264368+0000","last_peered":"2024-04-25T09:29:24.264368+0000","last_clean":"2024-04-25T09:29:24.264368+0000","last_became_active":"2024-04-25T09:28:00.009585+0000","last_became_peered":"2024-04-25T09:28:00.009585+0000","last_unstale":"2024-04-25T09:29:24.264368+0000","last_undegraded":"2024-04-25T09:29:24.264368+0000","last_fullsized":"2024-04-25T09:29:24.264368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:58.806760+0000","last_clean_scrub_stamp":"2024-04-25T09:27:58.806760+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T09:28:17.465192+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:28:17.465192+0000","last_peered":"2024-04-25T09:28:17.465192+0000","last_clean":"2024-04-25T09:28:17.465192+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:28:17.465192+0000","last_undegraded":"2024-04-25T09:28:17.465192+0000","last_fullsized":"2024-04-25T09:28:17.465192+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":104833024,"num_objects":1600,"num_object_clones":0,"num_object_copies":4800,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12797,"num_write_kb":102376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":157618176,"data_stored":315236352,"data_compressed":16274130,"data_compressed_allocated":157618176,"data_compressed_original":315236352,"omap_allocated":0,"internal_metadata":0},"log_size":12781,"ondisk_log_size":12781,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673064,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83684,"kb_used_data":44380,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94288156,"statfs":{"total":96636764160,"available":96551071744,"internally_reserved":0,"allocated":45445120,"data_stored":91032387,"data_compressed":4695985,"data_compressed_allocated":45232128,"data_compressed_original":90955776,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673064,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66832,"kb_used_data":35848,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94305008,"statfs":{"total":96636764160,"available":96568328192,"internally_reserved":0,"allocated":36708352,"data_stored":73558851,"data_compressed":3793900,"data_compressed_allocated":36495360,"data_compressed_original":73482240,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69804,"kb_used_data":38820,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94302036,"statfs":{"total":96636764160,"available":96565284864,"internally_reserved":0,"allocated":39751680,"data_stored":79178019,"data_compressed":4084456,"data_compressed_allocated":39559168,"data_compressed_original":79118336,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61128,"kb_used_data":34304,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94310712,"statfs":{"total":96636764160,"available":96574169088,"internally_reserved":0,"allocated":35127296,"data_stored":70396739,"data_compressed":3630642,"data_compressed_allocated":34914304,"data_compressed_original":70320128,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35278848,"data_stored":70557696,"data_compressed":3642552,"data_compressed_allocated":35278848,"data_compressed_original":70557696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39997440,"data_stored":79994880,"data_compressed":4129717,"data_compressed_allocated":39997440,"data_compressed_original":79994880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36716544,"data_stored":73433088,"data_compressed":3791005,"data_compressed_allocated":36716544,"data_compressed_original":73433088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45625344,"data_stored":91250688,"data_compressed":4710856,"data_compressed_allocated":45625344,"data_compressed_original":91250688,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:29:30.898 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 15 13357 13342 1.15805 1.01562 0.0541921 0.107807 2024-04-25T09:29:31.217 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:31.324 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:31.337+0000 7f295dead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:31.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:31.343+0000 7f295dead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:31.898 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1509 2024-04-25T09:29:31.898 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 13357 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.15752 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.102026 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.41406 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.90625 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 148 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 13.0593 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 181 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 116 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.107894 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.0548192 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.418395 2024-04-25T09:29:31.899 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0160421 2024-04-25T09:29:31.922 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:29:33.422 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:33.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:33.582+0000 7f37e131d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:33.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:33.590+0000 7f37e131d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:35.689 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:35.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:35.689 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:29:35.690 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:29:35.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:35.874+0000 7fc58262d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:35.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:35.889+0000 7fc58262d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:35.905 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:35.905 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:35.905 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:35.905 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:35.905 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:35.905 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:35.905 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:35.906 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:35.906 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:35.906 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:35.906 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:35.906 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:35.908 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:35.909 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:35.909 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:29:35.959 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:36.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.087+0000 7f712ed54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.102+0000 7f712ed54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.108 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:36.108 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:36.109 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:36.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.120+0000 7f75ed26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:36.112 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:36.112 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:29:36.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.127+0000 7f75ed26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.269+0000 7f9d0666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.269 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.284+0000 7f9d0666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.310 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:36.310 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:36.310 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:36.310 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:36.311 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:36.314 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:36.314 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:36.314 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:29:36.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.493+0000 7f601b4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:36.504+0000 7f601b4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:36.624 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:36.624 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:36.624 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:36.624 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:36.624 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:36.624 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:36.624 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:36.625 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:36.625 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:36.625 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:36.625 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:36.625 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:36.630 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:36.631 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:38.437 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:38.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:38.598+0000 7f5da519d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:38.593 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:38.608+0000 7f5da519d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:40.963 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:41.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:41.140+0000 7f2dd1c0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:41.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:41.147+0000 7f2dd1c0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:41.631 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:41.632 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:41.632 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:29:41.632 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:29:41.662 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1670 objects 2024-04-25T09:29:41.662 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :9.74004 2024-04-25T09:29:41.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:41.757+0000 7f207f15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:41.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:41.766+0000 7f207f15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:41.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:41.768 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:41.768 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:29:41.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:41.927+0000 7fd0afb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:41.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:41.937+0000 7fd0afb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:41.954 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:41.955 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:41.956 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:41.956 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:29:42.065 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:42.075+0000 7ff21655d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:42.068 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:42.083+0000 7ff21655d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:42.085 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:42.085 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:42.085 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:42.085 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:42.085 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:42.086 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:42.086 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:42.086 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:42.086 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:42.086 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:42.086 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:42.086 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:42.088 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:42.089 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:42.089 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:29:42.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:42.208+0000 7f63c1d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:42.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:42.217+0000 7f63c1d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:42.218 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:42.219 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:42.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:42.221 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:43.544 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:43.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:43.675+0000 7f1044eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:43.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:43.680+0000 7f1044eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:44.549 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-25T09:29:44.550 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-25T09:29:44.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:44.671+0000 7f867e2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:44.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:44.683+0000 7f867e2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:45.289 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_0' removed 2024-04-25T09:29:45.304 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:29:45.305 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:29:45.305 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-04-25T09:29:45.305 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-04-25T09:29:45.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:45.424+0000 7f8b40cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:45.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:45.435+0000 7f8b40cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:45.763 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:45.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:45.881+0000 7f610ad5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:45.871 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:45.886+0000 7f610ad5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:46.293 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_1' created 2024-04-25T09:29:46.311 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-04-25T09:29:46.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:46.483+0000 7f2229424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:46.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:46.507+0000 7f2229424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.222 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:47.222 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:47.222 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:29:47.223 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:29:47.297 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-04-25T09:29:47.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.358+0000 7f916086d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.372+0000 7f916086d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.480 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:47.480 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:47.481 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:47.484 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:47.484 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:47.485 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:29:47.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.656+0000 7fb889554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.664+0000 7fb889554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.663 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:47.663 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:47.664 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:47.666 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:47.667 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:47.667 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:29:47.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.785+0000 7ff055dff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.793+0000 7ff054b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.794 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:47.794 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:47.794 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:47.794 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:47.795 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:47.797 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:47.797 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:47.798 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:29:47.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.915+0000 7f774995d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.908 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:47.923+0000 7f774995d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:47.924 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:47.924 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:47.924 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:47.924 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:47.924 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:47.925 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:47.925 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:47.925 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:47.925 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:47.925 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:47.925 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:47.925 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:47.927 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:47.927 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:47.965 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:48.071 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:48.084+0000 7f6afe19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:48.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:48.090+0000 7f6afe19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:48.319 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-04-25T09:29:48.322 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:29:48.322 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:29:48.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:29:48.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:29:48.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_34000 2024-04-25T09:29:48.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:29:48.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:29:49.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 140 124 0.968696 0.96875 0.134234 0.120389 2024-04-25T09:29:50.170 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:50.311 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:50.324+0000 7f106c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:50.317 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:50.332+0000 7f106c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:50.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 315 299 1.16789 1.36719 0.120931 0.103689 2024-04-25T09:29:51.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 488 472 1.22907 1.35156 0.0753741 0.100196 2024-04-25T09:29:52.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 670 654 1.27724 1.42188 0.118986 0.096675 2024-04-25T09:29:52.540 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:52.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:52.689+0000 7f64bf82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:52.683 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:52.698+0000 7f64bf82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:52.928 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:52.928 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:52.928 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:29:52.929 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:29:53.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.059+0000 7fefdd11d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.071+0000 7fefdd11d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.104 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:53.104 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:53.104 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:53.105 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:53.109 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:53.109 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:53.109 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:29:53.256 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.260+0000 7f73f9064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.276+0000 7f73f9064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.335 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:53.336 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:53.340 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:53.340 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:53.340 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:29:53.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 820 804 1.25615 1.17188 0.141138 0.0983367 2024-04-25T09:29:53.467 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.474+0000 7f80eb22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.472 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.487+0000 7f80eb22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:53.490 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:53.491 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:53.491 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:53.493 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:53.494 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:53.494 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:29:53.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.631+0000 7f21a715d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:53.643+0000 7f21a715d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:53.649 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:53.649 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:53.649 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:53.649 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:53.650 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:53.653 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:53.654 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:54.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 984 968 1.26031 1.28125 0.122828 0.0980139 2024-04-25T09:29:54.834 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:54.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:54.983+0000 7fe65960f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:54.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:54.991+0000 7fe65960f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:55.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 1142 1126 1.25659 1.23438 0.0499723 0.0985118 2024-04-25T09:29:56.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1305 1289 1.25868 1.27344 0.174 0.0984895 2024-04-25T09:29:57.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:29:57.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1466 1450 1.25857 1.25781 0.051494 0.0986351 2024-04-25T09:29:57.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:57.407+0000 7f13b219d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:57.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:57.414+0000 7f13b219d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:58.384 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 1632 1616 1.26239 1.29688 0.109083 0.0984319 2024-04-25T09:29:58.654 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:29:58.654 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:29:58.655 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:29:58.655 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:29:58.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:58.833+0000 7f9ac426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:58.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:58.844+0000 7f9ac426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:58.849 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:58.853 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:58.853 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:58.854 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:29:58.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:58.983+0000 7f659646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:58.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:58.994+0000 7f659646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:59.056 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:59.056 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:59.056 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:59.056 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:59.057 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:59.059 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:59.059 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:59.060 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:29:59.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:59.203+0000 7fb50e46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:59.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:59.214+0000 7fb50e46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:59.214 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:59.215 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:59.215 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:59.215 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:59.215 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:59.217 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:59.218 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:59.218 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:29:59.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:59.358+0000 7fd75082d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:59.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:59.373+0000 7fd75082d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:59.383 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:29:59.384 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:29:59.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1777 1761 1.2506 1.13281 0.0824665 0.0992198 2024-04-25T09:29:59.388 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:29:59.388 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:29:59.602 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:29:59.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:59.751+0000 7f7ecca2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:29:59.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:29:59.758+0000 7f7ecca2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:00.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1932 1916 1.24729 1.21094 0.145492 0.0998178 2024-04-25T09:30:01.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 2097 2081 1.25049 1.28906 0.0411154 0.0995052 2024-04-25T09:30:01.925 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:02.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:02.076+0000 7fbfd6e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:02.070 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:02.085+0000 7fbfd6e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:02.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 2265 2249 1.25491 1.3125 0.2177 0.0988247 2024-04-25T09:30:03.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2443 2427 1.26395 1.39062 0.0442286 0.0985521 2024-04-25T09:30:04.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:04.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2622 2606 1.27235 1.39844 0.158247 0.0978279 2024-04-25T09:30:04.389 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:04.390 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:04.390 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:04.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:04.405+0000 7f9bd90ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:04.398 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:04.413+0000 7f9bd90ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:04.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:04.570+0000 7fd7074ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:04.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:04.580+0000 7fd7074ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:04.909 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:04.909 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:04.932 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-04-25T09:30:03.253628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18317856,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2301,"num_write_kb":19206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2245,"ondisk_log_size":2245,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":165900,"kb_used_data":25324,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377321460,"statfs":{"total":386547056640,"available":386377175040,"internally_reserved":0,"allocated":25931776,"data_stored":51725720,"data_compressed":2650797,"data_compressed_allocated":24952832,"data_compressed_original":51380224,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17727488,"num_objects":272,"num_object_clones":0,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2164,"num_write_kb":17312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002776"},"pg_stats":[{"pgid":"4.f","version":"27'159","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.913796+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:01.913796+0000","last_peered":"2024-04-25T09:30:01.913796+0000","last_clean":"2024-04-25T09:30:01.913796+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:01.913796+0000","last_undegraded":"2024-04-25T09:30:01.913796+0000","last_fullsized":"2024-04-25T09:30:01.913796+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"27'175","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:02.119746+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:02.119746+0000","last_peered":"2024-04-25T09:30:02.119746+0000","last_clean":"2024-04-25T09:30:02.119746+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:02.119746+0000","last_undegraded":"2024-04-25T09:30:02.119746+0000","last_fullsized":"2024-04-25T09:30:02.119746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'119","reported_seq":132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:59.123127+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:29:59.123127+0000","last_peered":"2024-04-25T09:29:59.123127+0000","last_clean":"2024-04-25T09:29:59.123127+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:29:59.123127+0000","last_undegraded":"2024-04-25T09:29:59.123127+0000","last_fullsized":"2024-04-25T09:29:59.123127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'127","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.784713+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:01.784713+0000","last_peered":"2024-04-25T09:30:01.784713+0000","last_clean":"2024-04-25T09:30:01.784713+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:01.784713+0000","last_undegraded":"2024-04-25T09:30:01.784713+0000","last_fullsized":"2024-04-25T09:30:01.784713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"27'175","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.027528+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:01.027528+0000","last_peered":"2024-04-25T09:30:01.027528+0000","last_clean":"2024-04-25T09:30:01.027528+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:01.027528+0000","last_undegraded":"2024-04-25T09:30:01.027528+0000","last_fullsized":"2024-04-25T09:30:01.027528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"27'119","reported_seq":132,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.324763+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:01.324763+0000","last_peered":"2024-04-25T09:30:01.324763+0000","last_clean":"2024-04-25T09:30:01.324763+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:01.324763+0000","last_undegraded":"2024-04-25T09:30:01.324763+0000","last_fullsized":"2024-04-25T09:30:01.324763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"27'147","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.387515+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:01.387515+0000","last_peered":"2024-04-25T09:30:01.387515+0000","last_clean":"2024-04-25T09:30:01.387515+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:01.387515+0000","last_undegraded":"2024-04-25T09:30:01.387515+0000","last_fullsized":"2024-04-25T09:30:01.387515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1212416,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"27'102","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.392062+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:01.392062+0000","last_peered":"2024-04-25T09:30:01.392062+0000","last_clean":"2024-04-25T09:30:01.392062+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:01.392062+0000","last_undegraded":"2024-04-25T09:30:01.392062+0000","last_fullsized":"2024-04-25T09:30:01.392062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843776,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'143","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:00.684317+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:00.684317+0000","last_peered":"2024-04-25T09:30:00.684317+0000","last_clean":"2024-04-25T09:30:00.684317+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:00.684317+0000","last_undegraded":"2024-04-25T09:30:00.684317+0000","last_fullsized":"2024-04-25T09:30:00.684317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.016749+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:29:49.016749+0000","last_peered":"2024-04-25T09:29:49.016749+0000","last_clean":"2024-04-25T09:29:49.016749+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:29:49.016749+0000","last_undegraded":"2024-04-25T09:29:49.016749+0000","last_fullsized":"2024-04-25T09:29:49.016749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.423238+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:29:48.423238+0000","last_peered":"2024-04-25T09:29:48.423238+0000","last_clean":"2024-04-25T09:29:48.423238+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:29:48.423238+0000","last_undegraded":"2024-04-25T09:29:48.423238+0000","last_fullsized":"2024-04-25T09:29:48.423238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"27'183","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.137926+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:01.137926+0000","last_peered":"2024-04-25T09:30:01.137926+0000","last_clean":"2024-04-25T09:30:01.137926+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:01.137926+0000","last_undegraded":"2024-04-25T09:30:01.137926+0000","last_fullsized":"2024-04-25T09:30:01.137926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.344270+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:29:48.344270+0000","last_peered":"2024-04-25T09:29:48.344270+0000","last_clean":"2024-04-25T09:29:48.344270+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:29:48.344270+0000","last_undegraded":"2024-04-25T09:29:48.344270+0000","last_fullsized":"2024-04-25T09:29:48.344270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'140","reported_seq":153,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:02.407495+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:02.407495+0000","last_peered":"2024-04-25T09:30:02.407495+0000","last_clean":"2024-04-25T09:30:02.407495+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:02.407495+0000","last_undegraded":"2024-04-25T09:30:02.407495+0000","last_fullsized":"2024-04-25T09:30:02.407495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155072,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":1128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.420878+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:29:48.420878+0000","last_peered":"2024-04-25T09:29:48.420878+0000","last_clean":"2024-04-25T09:29:48.420878+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:29:48.420878+0000","last_undegraded":"2024-04-25T09:29:48.420878+0000","last_fullsized":"2024-04-25T09:29:48.420878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"27'127","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.729431+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:01.729431+0000","last_peered":"2024-04-25T09:30:01.729431+0000","last_clean":"2024-04-25T09:30:01.729431+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:01.729431+0000","last_undegraded":"2024-04-25T09:30:01.729431+0000","last_fullsized":"2024-04-25T09:30:01.729431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.350684+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:29:48.350684+0000","last_peered":"2024-04-25T09:29:48.350684+0000","last_clean":"2024-04-25T09:29:48.350684+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:29:48.350684+0000","last_undegraded":"2024-04-25T09:29:48.350684+0000","last_fullsized":"2024-04-25T09:29:48.350684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"27'55","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:00.663581+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:00.663581+0000","last_peered":"2024-04-25T09:30:00.663581+0000","last_clean":"2024-04-25T09:30:00.663581+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:00.663581+0000","last_undegraded":"2024-04-25T09:30:00.663581+0000","last_fullsized":"2024-04-25T09:30:00.663581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.706576+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:29:48.706576+0000","last_peered":"2024-04-25T09:29:48.706576+0000","last_clean":"2024-04-25T09:29:48.706576+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:29:48.706576+0000","last_undegraded":"2024-04-25T09:29:48.706576+0000","last_fullsized":"2024-04-25T09:29:48.706576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"27'135","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.053854+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:01.053854+0000","last_peered":"2024-04-25T09:30:01.053854+0000","last_clean":"2024-04-25T09:30:01.053854+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:01.053854+0000","last_undegraded":"2024-04-25T09:30:01.053854+0000","last_fullsized":"2024-04-25T09:30:01.053854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.024898+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:29:49.024898+0000","last_peered":"2024-04-25T09:29:49.024898+0000","last_clean":"2024-04-25T09:29:49.024898+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:29:49.024898+0000","last_undegraded":"2024-04-25T09:29:49.024898+0000","last_fullsized":"2024-04-25T09:29:49.024898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'171","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.392647+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:01.392647+0000","last_peered":"2024-04-25T09:30:01.392647+0000","last_clean":"2024-04-25T09:30:01.392647+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:01.392647+0000","last_undegraded":"2024-04-25T09:30:01.392647+0000","last_fullsized":"2024-04-25T09:30:01.392647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1409024,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":1376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.718138+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:29:48.718138+0000","last_peered":"2024-04-25T09:29:48.718138+0000","last_clean":"2024-04-25T09:29:48.718138+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:29:48.718138+0000","last_undegraded":"2024-04-25T09:29:48.718138+0000","last_fullsized":"2024-04-25T09:29:48.718138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"27'71","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:01.231418+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:01.231418+0000","last_peered":"2024-04-25T09:30:01.231418+0000","last_clean":"2024-04-25T09:30:01.231418+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:01.231418+0000","last_undegraded":"2024-04-25T09:30:01.231418+0000","last_fullsized":"2024-04-25T09:30:01.231418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.441358+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:29:48.441358+0000","last_peered":"2024-04-25T09:29:48.441358+0000","last_clean":"2024-04-25T09:29:48.441358+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:29:48.441358+0000","last_undegraded":"2024-04-25T09:29:48.441358+0000","last_fullsized":"2024-04-25T09:29:48.441358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":17727488,"num_objects":272,"num_object_clones":0,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2164,"num_write_kb":17312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26689536,"data_stored":53379072,"data_compressed":2752938,"data_compressed_allocated":26689536,"data_compressed_original":53379072,"omap_allocated":0,"internal_metadata":0},"log_size":2148,"ondisk_log_size":2148,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42168,"kb_used_data":7024,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94329672,"statfs":{"total":96636764160,"available":96593584128,"internally_reserved":0,"allocated":7192576,"data_stored":14467566,"data_compressed":741848,"data_compressed_allocated":6942720,"data_compressed_original":14376960,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673099,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44980,"kb_used_data":5676,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94326860,"statfs":{"total":96636764160,"available":96590704640,"internally_reserved":0,"allocated":5812224,"data_stored":11706862,"data_compressed":599447,"data_compressed_allocated":5562368,"data_compressed_original":11616256,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33004,"kb_used_data":6180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":6328320,"data_stored":12271566,"data_compressed":628993,"data_compressed_allocated":6098944,"data_compressed_original":12197888,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45748,"kb_used_data":6444,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94326092,"statfs":{"total":96636764160,"available":96589918208,"internally_reserved":0,"allocated":6598656,"data_stored":13279726,"data_compressed":680509,"data_compressed_allocated":6348800,"data_compressed_original":13189120,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6754304,"data_stored":13508608,"data_compressed":696649,"data_compressed_allocated":6754304,"data_compressed_original":13508608,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6647808,"data_stored":13295616,"data_compressed":685675,"data_compressed_allocated":6647808,"data_compressed_original":13295616,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5951488,"data_stored":11902976,"data_compressed":613895,"data_compressed_allocated":5951488,"data_compressed_original":11902976,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7335936,"data_stored":14671872,"data_compressed":756719,"data_compressed_allocated":7335936,"data_compressed_original":14671872,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:05.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2770 2754 1.26551 1.15625 0.166132 0.0984086 2024-04-25T09:30:06.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2935 2919 1.26681 1.28906 0.0976165 0.0983241 2024-04-25T09:30:06.596 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:06.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:06.749+0000 7f2ce579d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:06.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:06.756+0000 7f2ce579d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:07.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 3084 3068 1.2614 1.16406 0.152536 0.0986466 2024-04-25T09:30:08.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:30:08.401889+0000 min lat: 0.0143996 max lat: 0.321158 avg lat: 0.099107 2024-04-25T09:30:08.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:30:08.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 3234 3218 1.25692 1.17188 0.0898227 0.099107 2024-04-25T09:30:08.909 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:09.075 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:09.088+0000 7f40f546d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:09.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:09.095+0000 7f40f546d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:09.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 3399 3383 1.25844 1.28906 0.0622867 0.0989183 2024-04-25T09:30:09.934 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:09.934 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:09.934 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:10.053 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:10.063+0000 7f1549c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:10.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:10.073+0000 7f1549c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:10.299 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:10.299 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:10.317 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-04-25T09:30:09.255047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24814112,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":3094,"num_write_kb":25550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3038,"ondisk_log_size":3038,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":177512,"kb_used_data":35528,"kb_used_omap":0,"kb_used_meta":141952,"kb_avail":377309848,"statfs":{"total":386547056640,"available":386365284352,"internally_reserved":0,"allocated":36380672,"data_stored":72623512,"data_compressed":3729870,"data_compressed_allocated":35401728,"data_compressed_original":72278016,"omap_allocated":0,"internal_metadata":145358848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15040512,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1836,"num_write_kb":14688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002681"},"pg_stats":[{"pgid":"4.f","version":"27'231","reported_seq":244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.518978+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:06.518978+0000","last_peered":"2024-04-25T09:30:06.518978+0000","last_clean":"2024-04-25T09:30:06.518978+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:06.518978+0000","last_undegraded":"2024-04-25T09:30:06.518978+0000","last_fullsized":"2024-04-25T09:30:06.518978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"27'250","reported_seq":263,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:07.394085+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:07.394085+0000","last_peered":"2024-04-25T09:30:07.394085+0000","last_clean":"2024-04-25T09:30:07.394085+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:07.394085+0000","last_undegraded":"2024-04-25T09:30:07.394085+0000","last_fullsized":"2024-04-25T09:30:07.394085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2056192,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":251,"num_write_kb":2008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'199","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.208093+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:06.208093+0000","last_peered":"2024-04-25T09:30:06.208093+0000","last_clean":"2024-04-25T09:30:06.208093+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:06.208093+0000","last_undegraded":"2024-04-25T09:30:06.208093+0000","last_fullsized":"2024-04-25T09:30:06.208093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'191","reported_seq":204,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.959376+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:06.959376+0000","last_peered":"2024-04-25T09:30:06.959376+0000","last_clean":"2024-04-25T09:30:06.959376+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:06.959376+0000","last_undegraded":"2024-04-25T09:30:06.959376+0000","last_fullsized":"2024-04-25T09:30:06.959376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"27'199","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:05.356934+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:05.356934+0000","last_peered":"2024-04-25T09:30:05.356934+0000","last_clean":"2024-04-25T09:30:05.356934+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:05.356934+0000","last_undegraded":"2024-04-25T09:30:05.356934+0000","last_fullsized":"2024-04-25T09:30:05.356934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"27'190","reported_seq":203,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.394632+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:06.394632+0000","last_peered":"2024-04-25T09:30:06.394632+0000","last_clean":"2024-04-25T09:30:06.394632+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:06.394632+0000","last_undegraded":"2024-04-25T09:30:06.394632+0000","last_fullsized":"2024-04-25T09:30:06.394632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564672,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":1528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"27'183","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:04.957552+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:04.957552+0000","last_peered":"2024-04-25T09:30:04.957552+0000","last_clean":"2024-04-25T09:30:04.957552+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:04.957552+0000","last_undegraded":"2024-04-25T09:30:04.957552+0000","last_fullsized":"2024-04-25T09:30:04.957552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"27'135","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:05.755739+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:05.755739+0000","last_peered":"2024-04-25T09:30:05.755739+0000","last_clean":"2024-04-25T09:30:05.755739+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:05.755739+0000","last_undegraded":"2024-04-25T09:30:05.755739+0000","last_fullsized":"2024-04-25T09:30:05.755739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'199","reported_seq":212,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.315138+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:06.315138+0000","last_peered":"2024-04-25T09:30:06.315138+0000","last_clean":"2024-04-25T09:30:06.315138+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:06.315138+0000","last_undegraded":"2024-04-25T09:30:06.315138+0000","last_fullsized":"2024-04-25T09:30:06.315138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.016749+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:29:49.016749+0000","last_peered":"2024-04-25T09:29:49.016749+0000","last_clean":"2024-04-25T09:29:49.016749+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:29:49.016749+0000","last_undegraded":"2024-04-25T09:29:49.016749+0000","last_fullsized":"2024-04-25T09:29:49.016749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.423238+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:29:48.423238+0000","last_peered":"2024-04-25T09:29:48.423238+0000","last_clean":"2024-04-25T09:29:48.423238+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:29:48.423238+0000","last_undegraded":"2024-04-25T09:29:48.423238+0000","last_fullsized":"2024-04-25T09:29:48.423238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"27'239","reported_seq":252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.257666+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:06.257666+0000","last_peered":"2024-04-25T09:30:06.257666+0000","last_clean":"2024-04-25T09:30:06.257666+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:06.257666+0000","last_undegraded":"2024-04-25T09:30:06.257666+0000","last_fullsized":"2024-04-25T09:30:06.257666+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.344270+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:29:48.344270+0000","last_peered":"2024-04-25T09:29:48.344270+0000","last_clean":"2024-04-25T09:29:48.344270+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:29:48.344270+0000","last_undegraded":"2024-04-25T09:29:48.344270+0000","last_fullsized":"2024-04-25T09:29:48.344270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'167","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.152045+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:06.152045+0000","last_peered":"2024-04-25T09:30:06.152045+0000","last_clean":"2024-04-25T09:30:06.152045+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:06.152045+0000","last_undegraded":"2024-04-25T09:30:06.152045+0000","last_fullsized":"2024-04-25T09:30:06.152045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.420878+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:29:48.420878+0000","last_peered":"2024-04-25T09:29:48.420878+0000","last_clean":"2024-04-25T09:29:48.420878+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:29:48.420878+0000","last_undegraded":"2024-04-25T09:29:48.420878+0000","last_fullsized":"2024-04-25T09:29:48.420878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"27'159","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:05.696264+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:05.696264+0000","last_peered":"2024-04-25T09:30:05.696264+0000","last_clean":"2024-04-25T09:30:05.696264+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:05.696264+0000","last_undegraded":"2024-04-25T09:30:05.696264+0000","last_fullsized":"2024-04-25T09:30:05.696264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.350684+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:29:48.350684+0000","last_peered":"2024-04-25T09:29:48.350684+0000","last_clean":"2024-04-25T09:29:48.350684+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:29:48.350684+0000","last_undegraded":"2024-04-25T09:29:48.350684+0000","last_fullsized":"2024-04-25T09:29:48.350684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"27'106","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.380338+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:06.380338+0000","last_peered":"2024-04-25T09:30:06.380338+0000","last_clean":"2024-04-25T09:30:06.380338+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:06.380338+0000","last_undegraded":"2024-04-25T09:30:06.380338+0000","last_fullsized":"2024-04-25T09:30:06.380338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876544,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.706576+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:29:48.706576+0000","last_peered":"2024-04-25T09:29:48.706576+0000","last_clean":"2024-04-25T09:29:48.706576+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:29:48.706576+0000","last_undegraded":"2024-04-25T09:29:48.706576+0000","last_fullsized":"2024-04-25T09:29:48.706576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"27'183","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:05.664755+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:05.664755+0000","last_peered":"2024-04-25T09:30:05.664755+0000","last_clean":"2024-04-25T09:30:05.664755+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:05.664755+0000","last_undegraded":"2024-04-25T09:30:05.664755+0000","last_fullsized":"2024-04-25T09:30:05.664755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.024898+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:29:49.024898+0000","last_peered":"2024-04-25T09:29:49.024898+0000","last_clean":"2024-04-25T09:29:49.024898+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:29:49.024898+0000","last_undegraded":"2024-04-25T09:29:49.024898+0000","last_fullsized":"2024-04-25T09:29:49.024898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'215","reported_seq":228,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.018590+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:06.018590+0000","last_peered":"2024-04-25T09:30:06.018590+0000","last_clean":"2024-04-25T09:30:06.018590+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:06.018590+0000","last_undegraded":"2024-04-25T09:30:06.018590+0000","last_fullsized":"2024-04-25T09:30:06.018590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.718138+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:29:48.718138+0000","last_peered":"2024-04-25T09:29:48.718138+0000","last_clean":"2024-04-25T09:29:48.718138+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:29:48.718138+0000","last_undegraded":"2024-04-25T09:29:48.718138+0000","last_fullsized":"2024-04-25T09:29:48.718138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"27'95","reported_seq":108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:06.367599+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:06.367599+0000","last_peered":"2024-04-25T09:30:06.367599+0000","last_clean":"2024-04-25T09:30:06.367599+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:06.367599+0000","last_undegraded":"2024-04-25T09:30:06.367599+0000","last_fullsized":"2024-04-25T09:30:06.367599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.441358+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:29:48.441358+0000","last_peered":"2024-04-25T09:29:48.441358+0000","last_clean":"2024-04-25T09:29:48.441358+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:29:48.441358+0000","last_undegraded":"2024-04-25T09:29:48.441358+0000","last_fullsized":"2024-04-25T09:29:48.441358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":24223744,"num_objects":371,"num_object_clones":0,"num_object_copies":1113,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2957,"num_write_kb":23656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36757504,"data_stored":73515008,"data_compressed":3792672,"data_compressed_allocated":36757504,"data_compressed_original":73515008,"omap_allocated":0,"internal_metadata":0},"log_size":2941,"ondisk_log_size":2941,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673104,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67104,"kb_used_data":9752,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94304736,"statfs":{"total":96636764160,"available":96568049664,"internally_reserved":0,"allocated":9986048,"data_stored":20054510,"data_compressed":1030334,"data_compressed_allocated":9736192,"data_compressed_original":19963904,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673104,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34860,"kb_used_data":8036,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94336980,"statfs":{"total":96636764160,"available":96601067520,"internally_reserved":0,"allocated":8228864,"data_stored":16540142,"data_compressed":849017,"data_compressed_allocated":7979008,"data_compressed_original":16449536,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705808,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39964,"kb_used_data":8980,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94331876,"statfs":{"total":96636764160,"available":96595841024,"internally_reserved":0,"allocated":9195520,"data_stored":18005966,"data_compressed":925093,"data_compressed_allocated":8966144,"data_compressed_original":17932288,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705808,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35584,"kb_used_data":8760,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94336256,"statfs":{"total":96636764160,"available":96600326144,"internally_reserved":0,"allocated":8970240,"data_stored":18022894,"data_compressed":925426,"data_compressed_allocated":8720384,"data_compressed_original":17932288,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9101312,"data_stored":18202624,"data_compressed":939028,"data_compressed_allocated":9101312,"data_compressed_original":18202624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9400320,"data_stored":18800640,"data_compressed":969931,"data_compressed_allocated":9400320,"data_compressed_original":18800640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8224768,"data_stored":16449536,"data_compressed":848660,"data_compressed_allocated":8224768,"data_compressed_original":16449536,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10031104,"data_stored":20062208,"data_compressed":1035053,"data_compressed_allocated":10031104,"data_compressed_original":20062208,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:10.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 3535 3519 1.24954 1.0625 0.0770461 0.0996437 2024-04-25T09:30:11.308 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:11.385 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3691 3675 1.24819 1.21875 0.078846 0.0998301 2024-04-25T09:30:11.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:11.459+0000 7feb60b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:11.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:11.465+0000 7feb60b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:12.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3840 3824 1.24468 1.16406 0.138999 0.100205 2024-04-25T09:30:13.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 4006 3990 1.24677 1.29688 0.106167 0.10004 2024-04-25T09:30:13.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:13.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:13.805+0000 7f5767a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:13.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:13.813+0000 7f5767a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:14.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 4165 4149 1.24659 1.24219 0.0979 0.100019 2024-04-25T09:30:15.319 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:15.319 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:15.320 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:30:15.320 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:30:15.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 4317 4301 1.2444 1.1875 0.0639325 0.100213 2024-04-25T09:30:15.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:15.502+0000 7fa82079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:15.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:15.518+0000 7fa82079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:15.544 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:15.545 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:15.545 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:15.545 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:15.545 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:15.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:15.548 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:15.549 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:30:15.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:15.699+0000 7fe18375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:15.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:15.714+0000 7fe18375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:15.726 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:15.726 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:15.726 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:15.726 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:15.726 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:15.727 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:15.727 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:15.727 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:15.727 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:15.727 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:15.727 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:15.727 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:15.729 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:15.729 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:15.730 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:30:15.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:15.866+0000 7ff80b82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:15.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:15.877+0000 7ff80b82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:15.878 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:15.879 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:15.879 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:15.879 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:15.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:15.882 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:15.882 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:30:16.018 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:16.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:16.031+0000 7f8b6c15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:16.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:16.047+0000 7f8b6c15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:16.054 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:16.055 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:16.055 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:16.055 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:16.055 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:16.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:16.058 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:16.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:16.182+0000 7f4cd0cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:16.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:16.192+0000 7f4cd0cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:16.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 4452 4436 1.23762 1.05469 0.174754 0.100738 2024-04-25T09:30:17.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 4624 4608 1.24127 1.34375 0.100365 0.100501 2024-04-25T09:30:18.319 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:18.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4780 4764 1.24052 1.21875 0.0629597 0.100548 2024-04-25T09:30:18.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:18.495+0000 7f7d1ac6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:18.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:18.503+0000 7f7d1ac6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:19.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4934 4918 1.23931 1.20312 0.1197 0.100605 2024-04-25T09:30:20.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 5076 5060 1.23524 1.10938 0.0293337 0.100933 2024-04-25T09:30:20.749 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:20.906 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:20.920+0000 7fd5bfb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:20.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:20.928+0000 7fd5bfb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:21.059 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:21.060 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:21.060 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:21.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:21.216+0000 7f3448eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:21.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:21.228+0000 7f3448eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:21.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 5218 5202 1.23143 1.10938 0.0599878 0.101166 2024-04-25T09:30:21.517 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:21.517 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:21.540 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-04-25T09:30:21.257658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":37618208,"num_objects":568,"num_object_clones":0,"num_object_copies":1704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":4657,"num_write_kb":38054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4601,"ondisk_log_size":4601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":195740,"kb_used_data":53752,"kb_used_omap":0,"kb_used_meta":141952,"kb_avail":377291620,"statfs":{"total":386547056640,"available":386346618880,"internally_reserved":0,"allocated":55042048,"data_stored":109946264,"data_compressed":5657058,"data_compressed_allocated":54063104,"data_compressed_original":109600768,"omap_allocated":0,"internal_metadata":145358848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12804096,"num_objects":195,"num_object_clones":0,"num_object_copies":585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1563,"num_write_kb":12504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002610"},"pg_stats":[{"pgid":"4.f","version":"27'343","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:17.404748+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:17.404748+0000","last_peered":"2024-04-25T09:30:17.404748+0000","last_clean":"2024-04-25T09:30:17.404748+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:17.404748+0000","last_undegraded":"2024-04-25T09:30:17.404748+0000","last_fullsized":"2024-04-25T09:30:17.404748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"27'367","reported_seq":380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:16.902480+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:16.902480+0000","last_peered":"2024-04-25T09:30:16.902480+0000","last_clean":"2024-04-25T09:30:16.902480+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:16.902480+0000","last_undegraded":"2024-04-25T09:30:16.902480+0000","last_fullsized":"2024-04-25T09:30:16.902480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'351","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:16.308110+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:16.308110+0000","last_peered":"2024-04-25T09:30:16.308110+0000","last_clean":"2024-04-25T09:30:16.308110+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:16.308110+0000","last_undegraded":"2024-04-25T09:30:16.308110+0000","last_fullsized":"2024-04-25T09:30:16.308110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'247","reported_seq":260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:17.296610+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:17.296610+0000","last_peered":"2024-04-25T09:30:17.296610+0000","last_clean":"2024-04-25T09:30:17.296610+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:17.296610+0000","last_undegraded":"2024-04-25T09:30:17.296610+0000","last_fullsized":"2024-04-25T09:30:17.296610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"27'258","reported_seq":271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:16.399350+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:16.399350+0000","last_peered":"2024-04-25T09:30:16.399350+0000","last_clean":"2024-04-25T09:30:16.399350+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:16.399350+0000","last_undegraded":"2024-04-25T09:30:16.399350+0000","last_fullsized":"2024-04-25T09:30:16.399350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2121728,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":2072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"27'319","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:15.851051+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:15.851051+0000","last_peered":"2024-04-25T09:30:15.851051+0000","last_clean":"2024-04-25T09:30:15.851051+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:15.851051+0000","last_undegraded":"2024-04-25T09:30:15.851051+0000","last_fullsized":"2024-04-25T09:30:15.851051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"27'247","reported_seq":260,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:16.372847+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:16.372847+0000","last_peered":"2024-04-25T09:30:16.372847+0000","last_clean":"2024-04-25T09:30:16.372847+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:16.372847+0000","last_undegraded":"2024-04-25T09:30:16.372847+0000","last_fullsized":"2024-04-25T09:30:16.372847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"27'255","reported_seq":268,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:16.176335+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:16.176335+0000","last_peered":"2024-04-25T09:30:16.176335+0000","last_clean":"2024-04-25T09:30:16.176335+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:16.176335+0000","last_undegraded":"2024-04-25T09:30:16.176335+0000","last_fullsized":"2024-04-25T09:30:16.176335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'303","reported_seq":316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:15.925938+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:15.925938+0000","last_peered":"2024-04-25T09:30:15.925938+0000","last_clean":"2024-04-25T09:30:15.925938+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:15.925938+0000","last_undegraded":"2024-04-25T09:30:15.925938+0000","last_fullsized":"2024-04-25T09:30:15.925938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.016749+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:29:49.016749+0000","last_peered":"2024-04-25T09:29:49.016749+0000","last_clean":"2024-04-25T09:29:49.016749+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:29:49.016749+0000","last_undegraded":"2024-04-25T09:29:49.016749+0000","last_fullsized":"2024-04-25T09:29:49.016749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.423238+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:29:48.423238+0000","last_peered":"2024-04-25T09:29:48.423238+0000","last_clean":"2024-04-25T09:29:48.423238+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:29:48.423238+0000","last_undegraded":"2024-04-25T09:29:48.423238+0000","last_fullsized":"2024-04-25T09:29:48.423238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"27'295","reported_seq":308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:14.111641+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:14.111641+0000","last_peered":"2024-04-25T09:30:14.111641+0000","last_clean":"2024-04-25T09:30:14.111641+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:14.111641+0000","last_undegraded":"2024-04-25T09:30:14.111641+0000","last_fullsized":"2024-04-25T09:30:14.111641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.344270+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:29:48.344270+0000","last_peered":"2024-04-25T09:29:48.344270+0000","last_clean":"2024-04-25T09:29:48.344270+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:29:48.344270+0000","last_undegraded":"2024-04-25T09:29:48.344270+0000","last_fullsized":"2024-04-25T09:29:48.344270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'295","reported_seq":308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:17.172325+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:17.172325+0000","last_peered":"2024-04-25T09:30:17.172325+0000","last_clean":"2024-04-25T09:30:17.172325+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:17.172325+0000","last_undegraded":"2024-04-25T09:30:17.172325+0000","last_fullsized":"2024-04-25T09:30:17.172325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.420878+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:29:48.420878+0000","last_peered":"2024-04-25T09:29:48.420878+0000","last_clean":"2024-04-25T09:29:48.420878+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:29:48.420878+0000","last_undegraded":"2024-04-25T09:29:48.420878+0000","last_fullsized":"2024-04-25T09:29:48.420878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"27'231","reported_seq":244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:17.303882+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:17.303882+0000","last_peered":"2024-04-25T09:30:17.303882+0000","last_clean":"2024-04-25T09:30:17.303882+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:17.303882+0000","last_undegraded":"2024-04-25T09:30:17.303882+0000","last_fullsized":"2024-04-25T09:30:17.303882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.350684+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:29:48.350684+0000","last_peered":"2024-04-25T09:29:48.350684+0000","last_clean":"2024-04-25T09:29:48.350684+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:29:48.350684+0000","last_undegraded":"2024-04-25T09:29:48.350684+0000","last_fullsized":"2024-04-25T09:29:48.350684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"27'220","reported_seq":233,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:16.410804+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:16.410804+0000","last_peered":"2024-04-25T09:30:16.410804+0000","last_clean":"2024-04-25T09:30:16.410804+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:16.410804+0000","last_undegraded":"2024-04-25T09:30:16.410804+0000","last_fullsized":"2024-04-25T09:30:16.410804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1810432,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.706576+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:29:48.706576+0000","last_peered":"2024-04-25T09:29:48.706576+0000","last_clean":"2024-04-25T09:29:48.706576+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:29:48.706576+0000","last_undegraded":"2024-04-25T09:29:48.706576+0000","last_fullsized":"2024-04-25T09:29:48.706576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"27'327","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:15.297530+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:15.297530+0000","last_peered":"2024-04-25T09:30:15.297530+0000","last_clean":"2024-04-25T09:30:15.297530+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:15.297530+0000","last_undegraded":"2024-04-25T09:30:15.297530+0000","last_fullsized":"2024-04-25T09:30:15.297530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.024898+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:29:49.024898+0000","last_peered":"2024-04-25T09:29:49.024898+0000","last_clean":"2024-04-25T09:29:49.024898+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:29:49.024898+0000","last_undegraded":"2024-04-25T09:29:49.024898+0000","last_fullsized":"2024-04-25T09:29:49.024898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'287","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:16.238680+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:16.238680+0000","last_peered":"2024-04-25T09:30:16.238680+0000","last_clean":"2024-04-25T09:30:16.238680+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:16.238680+0000","last_undegraded":"2024-04-25T09:30:16.238680+0000","last_fullsized":"2024-04-25T09:30:16.238680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.718138+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:29:48.718138+0000","last_peered":"2024-04-25T09:29:48.718138+0000","last_clean":"2024-04-25T09:29:48.718138+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:29:48.718138+0000","last_undegraded":"2024-04-25T09:29:48.718138+0000","last_fullsized":"2024-04-25T09:29:48.718138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"27'159","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:15.797101+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:15.797101+0000","last_peered":"2024-04-25T09:30:15.797101+0000","last_clean":"2024-04-25T09:30:15.797101+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:15.797101+0000","last_undegraded":"2024-04-25T09:30:15.797101+0000","last_fullsized":"2024-04-25T09:30:15.797101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.441358+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:29:48.441358+0000","last_peered":"2024-04-25T09:29:48.441358+0000","last_clean":"2024-04-25T09:29:48.441358+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:29:48.441358+0000","last_undegraded":"2024-04-25T09:29:48.441358+0000","last_fullsized":"2024-04-25T09:29:48.441358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":37027840,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4520,"num_write_kb":36160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55734272,"data_stored":111468544,"data_compressed":5752431,"data_compressed_allocated":55734272,"data_compressed_original":111468544,"omap_allocated":0,"internal_metadata":0},"log_size":4504,"ondisk_log_size":4504,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59248,"kb_used_data":14372,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312592,"statfs":{"total":96636764160,"available":96576094208,"internally_reserved":0,"allocated":14716928,"data_stored":29516270,"data_compressed":1518899,"data_compressed_allocated":14467072,"data_compressed_original":29425664,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43140,"kb_used_data":12156,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94328700,"statfs":{"total":96636764160,"available":96592588800,"internally_reserved":0,"allocated":12447744,"data_stored":24977902,"data_compressed":1284707,"data_compressed_allocated":12197888,"data_compressed_original":24887296,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49160,"kb_used_data":14016,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94322680,"statfs":{"total":96636764160,"available":96586424320,"internally_reserved":0,"allocated":14352384,"data_stored":28319694,"data_compressed":1457650,"data_compressed_allocated":14123008,"data_compressed_original":28246016,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44192,"kb_used_data":13208,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94327648,"statfs":{"total":96636764160,"available":96591511552,"internally_reserved":0,"allocated":13524992,"data_stored":27132398,"data_compressed":1395802,"data_compressed_allocated":13275136,"data_compressed_original":27041792,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13643776,"data_stored":27287552,"data_compressed":1408135,"data_compressed_allocated":13643776,"data_compressed_original":27287552,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14532608,"data_stored":29065216,"data_compressed":1499950,"data_compressed_allocated":14532608,"data_compressed_original":29065216,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12648448,"data_stored":25296896,"data_compressed":1305500,"data_compressed_allocated":12648448,"data_compressed_original":25296896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14909440,"data_stored":29818880,"data_compressed":1538846,"data_compressed_allocated":14909440,"data_compressed_original":29818880,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:22.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 5366 5350 1.22921 1.15625 0.10666 0.101478 2024-04-25T09:30:23.094 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:23.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:23.241+0000 7f0af575d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:23.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:23.250+0000 7f0af575d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:23.386 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 5516 5500 1.22757 1.17188 0.0959162 0.101636 2024-04-25T09:30:24.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 5664 5648 1.22559 1.15625 0.0246071 0.101773 2024-04-25T09:30:25.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5818 5802 1.22498 1.20312 0.13871 0.101868 2024-04-25T09:30:25.443 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:25.575 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:25.587+0000 7fbb1566d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:25.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:25.595+0000 7fbb1566d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:26.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5973 5957 1.2246 1.21094 0.188429 0.101896 2024-04-25T09:30:26.542 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:26.542 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:26.543 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:26.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:26.706+0000 7f69680ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:26.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:26.718+0000 7f69680ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:27.045 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:27.046 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:27.062 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-04-25T09:30:25.258567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43590176,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5386,"num_write_kb":43886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5330,"ondisk_log_size":5330,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":239608,"kb_used_data":62932,"kb_used_omap":0,"kb_used_meta":176640,"kb_avail":377247752,"statfs":{"total":386547056640,"available":386301698048,"internally_reserved":0,"allocated":64442368,"data_stored":128746904,"data_compressed":6627843,"data_compressed_allocated":63463424,"data_compressed_original":128401408,"omap_allocated":0,"internal_metadata":180879360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12500992,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1526,"num_write_kb":12208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002562"},"pg_stats":[{"pgid":"4.f","version":"27'367","reported_seq":380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:22.293640+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:22.293640+0000","last_peered":"2024-04-25T09:30:22.293640+0000","last_clean":"2024-04-25T09:30:22.293640+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:22.293640+0000","last_undegraded":"2024-04-25T09:30:22.293640+0000","last_fullsized":"2024-04-25T09:30:22.293640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"27'383","reported_seq":396,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:20.298871+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:20.298871+0000","last_peered":"2024-04-25T09:30:20.298871+0000","last_clean":"2024-04-25T09:30:20.298871+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:20.298871+0000","last_undegraded":"2024-04-25T09:30:20.298871+0000","last_fullsized":"2024-04-25T09:30:20.298871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'404","reported_seq":417,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:21.377856+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:21.377856+0000","last_peered":"2024-04-25T09:30:21.377856+0000","last_clean":"2024-04-25T09:30:21.377856+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:21.377856+0000","last_undegraded":"2024-04-25T09:30:21.377856+0000","last_fullsized":"2024-04-25T09:30:21.377856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3317760,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":405,"num_write_kb":3240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'287","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:22.037908+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:22.037908+0000","last_peered":"2024-04-25T09:30:22.037908+0000","last_clean":"2024-04-25T09:30:22.037908+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:22.037908+0000","last_undegraded":"2024-04-25T09:30:22.037908+0000","last_fullsized":"2024-04-25T09:30:22.037908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"27'354","reported_seq":367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:21.411159+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:21.411159+0000","last_peered":"2024-04-25T09:30:21.411159+0000","last_clean":"2024-04-25T09:30:21.411159+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:21.411159+0000","last_undegraded":"2024-04-25T09:30:21.411159+0000","last_fullsized":"2024-04-25T09:30:21.411159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2908160,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":355,"num_write_kb":2840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"27'351","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:21.175975+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:21.175975+0000","last_peered":"2024-04-25T09:30:21.175975+0000","last_clean":"2024-04-25T09:30:21.175975+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:21.175975+0000","last_undegraded":"2024-04-25T09:30:21.175975+0000","last_fullsized":"2024-04-25T09:30:21.175975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"27'287","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:20.615296+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:20.615296+0000","last_peered":"2024-04-25T09:30:20.615296+0000","last_clean":"2024-04-25T09:30:20.615296+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:20.615296+0000","last_undegraded":"2024-04-25T09:30:20.615296+0000","last_fullsized":"2024-04-25T09:30:20.615296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"27'303","reported_seq":316,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:20.735785+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:20.735785+0000","last_peered":"2024-04-25T09:30:20.735785+0000","last_clean":"2024-04-25T09:30:20.735785+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:20.735785+0000","last_undegraded":"2024-04-25T09:30:20.735785+0000","last_fullsized":"2024-04-25T09:30:20.735785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'319","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:18.696326+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:18.696326+0000","last_peered":"2024-04-25T09:30:18.696326+0000","last_clean":"2024-04-25T09:30:18.696326+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:18.696326+0000","last_undegraded":"2024-04-25T09:30:18.696326+0000","last_fullsized":"2024-04-25T09:30:18.696326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.016749+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:29:49.016749+0000","last_peered":"2024-04-25T09:29:49.016749+0000","last_clean":"2024-04-25T09:29:49.016749+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:29:49.016749+0000","last_undegraded":"2024-04-25T09:29:49.016749+0000","last_fullsized":"2024-04-25T09:29:49.016749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.423238+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:29:48.423238+0000","last_peered":"2024-04-25T09:29:48.423238+0000","last_clean":"2024-04-25T09:29:48.423238+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:29:48.423238+0000","last_undegraded":"2024-04-25T09:29:48.423238+0000","last_fullsized":"2024-04-25T09:29:48.423238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"27'351","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:20.062338+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:20.062338+0000","last_peered":"2024-04-25T09:30:20.062338+0000","last_clean":"2024-04-25T09:30:20.062338+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:20.062338+0000","last_undegraded":"2024-04-25T09:30:20.062338+0000","last_fullsized":"2024-04-25T09:30:20.062338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.344270+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:29:48.344270+0000","last_peered":"2024-04-25T09:29:48.344270+0000","last_clean":"2024-04-25T09:29:48.344270+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:29:48.344270+0000","last_undegraded":"2024-04-25T09:29:48.344270+0000","last_fullsized":"2024-04-25T09:29:48.344270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'319","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:20.998932+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:20.998932+0000","last_peered":"2024-04-25T09:30:20.998932+0000","last_clean":"2024-04-25T09:30:20.998932+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:20.998932+0000","last_undegraded":"2024-04-25T09:30:20.998932+0000","last_fullsized":"2024-04-25T09:30:20.998932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.420878+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:29:48.420878+0000","last_peered":"2024-04-25T09:29:48.420878+0000","last_clean":"2024-04-25T09:29:48.420878+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:29:48.420878+0000","last_undegraded":"2024-04-25T09:29:48.420878+0000","last_fullsized":"2024-04-25T09:29:48.420878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"27'263","reported_seq":276,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:22.229329+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:22.229329+0000","last_peered":"2024-04-25T09:30:22.229329+0000","last_clean":"2024-04-25T09:30:22.229329+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:22.229329+0000","last_undegraded":"2024-04-25T09:30:22.229329+0000","last_fullsized":"2024-04-25T09:30:22.229329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.350684+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:29:48.350684+0000","last_peered":"2024-04-25T09:29:48.350684+0000","last_clean":"2024-04-25T09:29:48.350684+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:29:48.350684+0000","last_undegraded":"2024-04-25T09:29:48.350684+0000","last_fullsized":"2024-04-25T09:29:48.350684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"27'336","reported_seq":349,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:21.220839+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:21.220839+0000","last_peered":"2024-04-25T09:30:21.220839+0000","last_clean":"2024-04-25T09:30:21.220839+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:21.220839+0000","last_undegraded":"2024-04-25T09:30:21.220839+0000","last_fullsized":"2024-04-25T09:30:21.220839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2760704,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":2696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.706576+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:29:48.706576+0000","last_peered":"2024-04-25T09:29:48.706576+0000","last_clean":"2024-04-25T09:29:48.706576+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:29:48.706576+0000","last_undegraded":"2024-04-25T09:29:48.706576+0000","last_fullsized":"2024-04-25T09:29:48.706576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"27'351","reported_seq":364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:20.904403+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:20.904403+0000","last_peered":"2024-04-25T09:30:20.904403+0000","last_clean":"2024-04-25T09:30:20.904403+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:20.904403+0000","last_undegraded":"2024-04-25T09:30:20.904403+0000","last_fullsized":"2024-04-25T09:30:20.904403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.024898+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:29:49.024898+0000","last_peered":"2024-04-25T09:29:49.024898+0000","last_clean":"2024-04-25T09:29:49.024898+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:29:49.024898+0000","last_undegraded":"2024-04-25T09:29:49.024898+0000","last_fullsized":"2024-04-25T09:29:49.024898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'327","reported_seq":340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:21.280263+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:21.280263+0000","last_peered":"2024-04-25T09:30:21.280263+0000","last_clean":"2024-04-25T09:30:21.280263+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:21.280263+0000","last_undegraded":"2024-04-25T09:30:21.280263+0000","last_fullsized":"2024-04-25T09:30:21.280263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.718138+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:29:48.718138+0000","last_peered":"2024-04-25T09:29:48.718138+0000","last_clean":"2024-04-25T09:29:48.718138+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:29:48.718138+0000","last_undegraded":"2024-04-25T09:29:48.718138+0000","last_fullsized":"2024-04-25T09:29:48.718138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"27'231","reported_seq":244,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:20.902728+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:20.902728+0000","last_peered":"2024-04-25T09:30:20.902728+0000","last_clean":"2024-04-25T09:30:20.902728+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:20.902728+0000","last_undegraded":"2024-04-25T09:30:20.902728+0000","last_fullsized":"2024-04-25T09:30:20.902728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.441358+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:29:48.441358+0000","last_peered":"2024-04-25T09:29:48.441358+0000","last_clean":"2024-04-25T09:29:48.441358+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:29:48.441358+0000","last_undegraded":"2024-04-25T09:29:48.441358+0000","last_fullsized":"2024-04-25T09:29:48.441358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42999808,"num_objects":658,"num_object_clones":0,"num_object_copies":1974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":41992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64892928,"data_stored":129785856,"data_compressed":6698259,"data_compressed_allocated":64892928,"data_compressed_original":129785856,"omap_allocated":0,"internal_metadata":0},"log_size":5233,"ondisk_log_size":5233,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673119,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65764,"kb_used_data":16732,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94306076,"statfs":{"total":96636764160,"available":96569421824,"internally_reserved":0,"allocated":17133568,"data_stored":34349550,"data_compressed":1768469,"data_compressed_allocated":16883712,"data_compressed_original":34258944,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673119,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49308,"kb_used_data":14164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94322532,"statfs":{"total":96636764160,"available":96586272768,"internally_reserved":0,"allocated":14503936,"data_stored":29090286,"data_compressed":1497053,"data_compressed_allocated":14254080,"data_compressed_original":28999680,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705823,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73872,"kb_used_data":16516,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94297968,"statfs":{"total":96636764160,"available":96561119232,"internally_reserved":0,"allocated":16912384,"data_stored":33439694,"data_compressed":1722025,"data_compressed_allocated":16683008,"data_compressed_original":33366016,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705823,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50664,"kb_used_data":15520,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94321176,"statfs":{"total":96636764160,"available":96584884224,"internally_reserved":0,"allocated":15892480,"data_stored":31867374,"data_compressed":1640296,"data_compressed_allocated":15642624,"data_compressed_original":31776768,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15958016,"data_stored":31916032,"data_compressed":1647130,"data_compressed_allocated":15958016,"data_compressed_original":31916032,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17104896,"data_stored":34209792,"data_compressed":1765594,"data_compressed_allocated":17104896,"data_compressed_original":34209792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14577664,"data_stored":29155328,"data_compressed":1504733,"data_compressed_allocated":14577664,"data_compressed_original":29155328,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17252352,"data_stored":34504704,"data_compressed":1780802,"data_compressed_allocated":17252352,"data_compressed_original":34504704,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:27.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 6131 6115 1.22485 1.23438 0.132283 0.101906 2024-04-25T09:30:27.702 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:27.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:27.842+0000 7f796759d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:27.834 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:27.849+0000 7f796759d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:28.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:30:28.403626+0000 min lat: 0.0143996 max lat: 0.333628 avg lat: 0.102143 2024-04-25T09:30:28.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:30:28.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 6275 6259 1.22235 1.125 0.112768 0.102143 2024-04-25T09:30:29.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 6424 6408 1.22093 1.16406 0.0614002 0.102199 2024-04-25T09:30:30.083 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:30.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:30.243+0000 7f6d73b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:30.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:30.251+0000 7f6d73b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:30.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 6574 6558 1.21976 1.17188 0.0942195 0.10228 2024-04-25T09:30:31.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 6739 6723 1.22137 1.28906 0.114118 0.102208 2024-04-25T09:30:32.064 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:32.064 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:32.064 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:30:32.064 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:30:32.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.219+0000 7fae4c39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.232+0000 7fae4c39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:32.247 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:32.248 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:32.248 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:32.248 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:32.248 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:32.250 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:32.250 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:32.251 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:30:32.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 6902 6886 1.22255 1.27344 0.0869333 0.10211 2024-04-25T09:30:32.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.403+0000 7f257631d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.415+0000 7f257631d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.402 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:32.434 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:32.435 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:32.439 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:32.439 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:32.440 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:30:32.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.575+0000 7f53d08ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.585+0000 7f53d08ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.648+0000 7f3ef16ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.661+0000 7f3ef16ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.672 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:32.673 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:32.676 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:32.676 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:32.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:30:32.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.829+0000 7f31d3ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:32.842+0000 7f31d3ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:32.851 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:32.852 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:32.852 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:32.852 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:32.855 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:32.856 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:33.387 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 7040 7024 1.21934 1.07812 0.0421496 0.102382 2024-04-25T09:30:34.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 7197 7181 1.21949 1.22656 0.119335 0.102363 2024-04-25T09:30:34.848 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:34.978 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:34.991+0000 7ff7cc2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:34.983 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:34.998+0000 7ff7cc2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:35.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 7341 7325 1.21748 1.125 0.135957 0.102534 2024-04-25T09:30:36.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 7488 7472 1.21604 1.14844 0.0348725 0.102669 2024-04-25T09:30:37.133 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:37.280 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:37.293+0000 7f030159d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:37.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:37.299+0000 7f030159d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:37.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 7617 7601 1.21179 1.00781 0.195372 0.102934 2024-04-25T09:30:37.856 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:37.856 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:37.857 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:37.976 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:37.985+0000 7fbcaac2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:37.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:37.996+0000 7fbcaac2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:38.183 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:38.183 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:38.199 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-04-25T09:30:37.261233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":60195360,"num_objects":912,"num_object_clones":0,"num_object_copies":2736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7413,"num_write_kb":60102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7357,"ondisk_log_size":7357,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":298728,"kb_used_data":85952,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377188632,"statfs":{"total":386547056640,"available":386241159168,"internally_reserved":0,"allocated":88014848,"data_stored":175891864,"data_compressed":9062208,"data_compressed_allocated":87035904,"data_compressed_original":175546368,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16605184,"num_objects":252,"num_object_clones":0,"num_object_copies":756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2027,"num_write_kb":16216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002665"},"pg_stats":[{"pgid":"4.f","version":"27'479","reported_seq":492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:31.737314+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:31.737314+0000","last_peered":"2024-04-25T09:30:31.737314+0000","last_clean":"2024-04-25T09:30:31.737314+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:31.737314+0000","last_undegraded":"2024-04-25T09:30:31.737314+0000","last_fullsized":"2024-04-25T09:30:31.737314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"27'463","reported_seq":476,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:32.328681+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:32.328681+0000","last_peered":"2024-04-25T09:30:32.328681+0000","last_clean":"2024-04-25T09:30:32.328681+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:32.328681+0000","last_undegraded":"2024-04-25T09:30:32.328681+0000","last_fullsized":"2024-04-25T09:30:32.328681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'575","reported_seq":588,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:34.444610+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:34.444610+0000","last_peered":"2024-04-25T09:30:34.444610+0000","last_clean":"2024-04-25T09:30:34.444610+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:34.444610+0000","last_undegraded":"2024-04-25T09:30:34.444610+0000","last_fullsized":"2024-04-25T09:30:34.444610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'343","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:31.738075+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:31.738075+0000","last_peered":"2024-04-25T09:30:31.738075+0000","last_clean":"2024-04-25T09:30:31.738075+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:31.738075+0000","last_undegraded":"2024-04-25T09:30:31.738075+0000","last_fullsized":"2024-04-25T09:30:31.738075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"27'447","reported_seq":460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.890247+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:35.890247+0000","last_peered":"2024-04-25T09:30:35.890247+0000","last_clean":"2024-04-25T09:30:35.890247+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:35.890247+0000","last_undegraded":"2024-04-25T09:30:35.890247+0000","last_fullsized":"2024-04-25T09:30:35.890247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"27'535","reported_seq":548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.508063+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:35.508063+0000","last_peered":"2024-04-25T09:30:35.508063+0000","last_clean":"2024-04-25T09:30:35.508063+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:35.508063+0000","last_undegraded":"2024-04-25T09:30:35.508063+0000","last_fullsized":"2024-04-25T09:30:35.508063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"27'459","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:36.401305+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:36.401305+0000","last_peered":"2024-04-25T09:30:36.401305+0000","last_clean":"2024-04-25T09:30:36.401305+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:36.401305+0000","last_undegraded":"2024-04-25T09:30:36.401305+0000","last_fullsized":"2024-04-25T09:30:36.401305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3768320,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":3680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"27'439","reported_seq":452,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.315086+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:35.315086+0000","last_peered":"2024-04-25T09:30:35.315086+0000","last_clean":"2024-04-25T09:30:35.315086+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:35.315086+0000","last_undegraded":"2024-04-25T09:30:35.315086+0000","last_fullsized":"2024-04-25T09:30:35.315086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'423","reported_seq":436,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.870273+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:35.870273+0000","last_peered":"2024-04-25T09:30:35.870273+0000","last_clean":"2024-04-25T09:30:35.870273+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:35.870273+0000","last_undegraded":"2024-04-25T09:30:35.870273+0000","last_fullsized":"2024-04-25T09:30:35.870273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.016749+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:29:49.016749+0000","last_peered":"2024-04-25T09:29:49.016749+0000","last_clean":"2024-04-25T09:29:49.016749+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:29:49.016749+0000","last_undegraded":"2024-04-25T09:29:49.016749+0000","last_fullsized":"2024-04-25T09:29:49.016749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.423238+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:29:48.423238+0000","last_peered":"2024-04-25T09:29:48.423238+0000","last_clean":"2024-04-25T09:29:48.423238+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:29:48.423238+0000","last_undegraded":"2024-04-25T09:29:48.423238+0000","last_fullsized":"2024-04-25T09:29:48.423238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"27'479","reported_seq":492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.762922+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:35.762922+0000","last_peered":"2024-04-25T09:30:35.762922+0000","last_clean":"2024-04-25T09:30:35.762922+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:35.762922+0000","last_undegraded":"2024-04-25T09:30:35.762922+0000","last_fullsized":"2024-04-25T09:30:35.762922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.344270+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:29:48.344270+0000","last_peered":"2024-04-25T09:29:48.344270+0000","last_clean":"2024-04-25T09:29:48.344270+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:29:48.344270+0000","last_undegraded":"2024-04-25T09:29:48.344270+0000","last_fullsized":"2024-04-25T09:29:48.344270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'375","reported_seq":388,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:32.211477+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:32.211477+0000","last_peered":"2024-04-25T09:30:32.211477+0000","last_clean":"2024-04-25T09:30:32.211477+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:32.211477+0000","last_undegraded":"2024-04-25T09:30:32.211477+0000","last_fullsized":"2024-04-25T09:30:32.211477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.420878+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:29:48.420878+0000","last_peered":"2024-04-25T09:29:48.420878+0000","last_clean":"2024-04-25T09:29:48.420878+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:29:48.420878+0000","last_undegraded":"2024-04-25T09:29:48.420878+0000","last_fullsized":"2024-04-25T09:29:48.420878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"27'383","reported_seq":396,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:32.394879+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:32.394879+0000","last_peered":"2024-04-25T09:30:32.394879+0000","last_clean":"2024-04-25T09:30:32.394879+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:32.394879+0000","last_undegraded":"2024-04-25T09:30:32.394879+0000","last_fullsized":"2024-04-25T09:30:32.394879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.350684+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:29:48.350684+0000","last_peered":"2024-04-25T09:29:48.350684+0000","last_clean":"2024-04-25T09:29:48.350684+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:29:48.350684+0000","last_undegraded":"2024-04-25T09:29:48.350684+0000","last_fullsized":"2024-04-25T09:29:48.350684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"27'487","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.964750+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:35.964750+0000","last_peered":"2024-04-25T09:30:35.964750+0000","last_clean":"2024-04-25T09:30:35.964750+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:35.964750+0000","last_undegraded":"2024-04-25T09:30:35.964750+0000","last_fullsized":"2024-04-25T09:30:35.964750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.706576+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:29:48.706576+0000","last_peered":"2024-04-25T09:29:48.706576+0000","last_clean":"2024-04-25T09:29:48.706576+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:29:48.706576+0000","last_undegraded":"2024-04-25T09:29:48.706576+0000","last_fullsized":"2024-04-25T09:29:48.706576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"27'447","reported_seq":460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.930194+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:35.930194+0000","last_peered":"2024-04-25T09:30:35.930194+0000","last_clean":"2024-04-25T09:30:35.930194+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:35.930194+0000","last_undegraded":"2024-04-25T09:30:35.930194+0000","last_fullsized":"2024-04-25T09:30:35.930194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.024898+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:29:49.024898+0000","last_peered":"2024-04-25T09:29:49.024898+0000","last_clean":"2024-04-25T09:29:49.024898+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:29:49.024898+0000","last_undegraded":"2024-04-25T09:29:49.024898+0000","last_fullsized":"2024-04-25T09:29:49.024898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'535","reported_seq":548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:36.250164+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:36.250164+0000","last_peered":"2024-04-25T09:30:36.250164+0000","last_clean":"2024-04-25T09:30:36.250164+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:36.250164+0000","last_undegraded":"2024-04-25T09:30:36.250164+0000","last_fullsized":"2024-04-25T09:30:36.250164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.718138+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:29:48.718138+0000","last_peered":"2024-04-25T09:29:48.718138+0000","last_clean":"2024-04-25T09:29:48.718138+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:29:48.718138+0000","last_undegraded":"2024-04-25T09:29:48.718138+0000","last_fullsized":"2024-04-25T09:29:48.718138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"27'391","reported_seq":404,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:35.548156+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:35.548156+0000","last_peered":"2024-04-25T09:30:35.548156+0000","last_clean":"2024-04-25T09:30:35.548156+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:35.548156+0000","last_undegraded":"2024-04-25T09:30:35.548156+0000","last_fullsized":"2024-04-25T09:30:35.548156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.441358+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:29:48.441358+0000","last_peered":"2024-04-25T09:29:48.441358+0000","last_clean":"2024-04-25T09:29:48.441358+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:29:48.441358+0000","last_undegraded":"2024-04-25T09:29:48.441358+0000","last_fullsized":"2024-04-25T09:29:48.441358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":59604992,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7276,"num_write_kb":58208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88461312,"data_stored":176922624,"data_compressed":9132201,"data_compressed_allocated":88461312,"data_compressed_original":176922624,"omap_allocated":0,"internal_metadata":0},"log_size":7260,"ondisk_log_size":7260,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673129,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75176,"kb_used_data":21984,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94296664,"statfs":{"total":96636764160,"available":96559783936,"internally_reserved":0,"allocated":22511616,"data_stored":45105646,"data_compressed":2323868,"data_compressed_allocated":22261760,"data_compressed_original":45015040,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673129,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71112,"kb_used_data":17920,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94300728,"statfs":{"total":96636764160,"available":96563945472,"internally_reserved":0,"allocated":18350080,"data_stored":36782574,"data_compressed":1894250,"data_compressed_allocated":18100224,"data_compressed_original":36691968,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73160,"kb_used_data":24124,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94298680,"statfs":{"total":96636764160,"available":96561848320,"internally_reserved":0,"allocated":24702976,"data_stored":49020878,"data_compressed":2526571,"data_compressed_allocated":24473600,"data_compressed_original":48947200,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79280,"kb_used_data":21924,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94292560,"statfs":{"total":96636764160,"available":96555581440,"internally_reserved":0,"allocated":22450176,"data_stored":44982766,"data_compressed":2317519,"data_compressed_allocated":22200320,"data_compressed_original":44892160,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22593536,"data_stored":45187072,"data_compressed":2332390,"data_compressed_allocated":22593536,"data_compressed_original":45187072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24834048,"data_stored":49668096,"data_compressed":2563795,"data_compressed_allocated":24834048,"data_compressed_original":49668096,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18423808,"data_stored":36847616,"data_compressed":1901930,"data_compressed_allocated":18423808,"data_compressed_original":36847616,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22609920,"data_stored":45219840,"data_compressed":2334086,"data_compressed_allocated":22609920,"data_compressed_original":45219840,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:38.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 7741 7725 1.20693 0.96875 0.0281888 0.103408 2024-04-25T09:30:39.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 7891 7875 1.20624 1.17188 0.0482663 0.103426 2024-04-25T09:30:39.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:39.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:39.644+0000 7fd46886d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:39.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:39.650+0000 7fd46886d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:40.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 8037 8021 1.20497 1.14062 0.0607815 0.103582 2024-04-25T09:30:41.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 8198 8182 1.20597 1.25781 0.0802685 0.103505 2024-04-25T09:30:41.814 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:41.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:41.951+0000 7fa98e4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:41.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:41.959+0000 7fa98e4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:42.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 8343 8327 1.20461 1.13281 0.145273 0.103661 2024-04-25T09:30:43.202 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:43.202 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:30:43.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:43.355+0000 7ff2e1a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:43.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:43.368+0000 7ff2e1a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:43.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 8492 8476 1.20387 1.16406 0.147498 0.103701 2024-04-25T09:30:44.170 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:44.307 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:44.320+0000 7f132a22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:44.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:44.328+0000 7f132a22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:44.321 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:30:44.342 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:30:44.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 8633 8617 1.20204 1.10156 0.0838628 0.103828 2024-04-25T09:30:44.515 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:44.518+0000 7fe3e595d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:44.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:44.536+0000 7fe3e595d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:45.325 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:30:45.344 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:30:45.388 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 8771 8755 1.19987 1.07812 0.0730012 0.103996 2024-04-25T09:30:45.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:45.504+0000 7fed7359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:45.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:45.518+0000 7fed7359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.329 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:30:46.348 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:30:46.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 8914 8898 1.19844 1.11719 0.109549 0.10414 2024-04-25T09:30:46.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:46.505+0000 7f621426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:46.519+0000 7f621426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.646 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:46.801 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:46.814+0000 7f0a4c0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:46.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:46.821+0000 7f0a4c0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.337 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:30:47.352 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:30:47.353 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:47.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 9034 9018 1.19402 0.9375 0.218433 0.104488 2024-04-25T09:30:47.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:47.499+0000 7fd3b1c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:47.507+0000 7fd3b1c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.696 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:47.697 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:47.717 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-04-25T09:30:47.353993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":71983648,"num_objects":1093,"num_object_clones":0,"num_object_copies":3279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8852,"num_write_kb":71614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8799,"ondisk_log_size":8799,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":316056,"kb_used_data":103284,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377171304,"statfs":{"total":386547056640,"available":386223415296,"internally_reserved":0,"allocated":105762816,"data_stored":211374661,"data_compressed":10894221,"data_compressed_allocated":104775680,"data_compressed_original":211025920,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3891200,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":3800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.091559"},"pg_stats":[{"pgid":"4.f","version":"27'583","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:41.119277+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:41.119277+0000","last_peered":"2024-04-25T09:30:41.119277+0000","last_clean":"2024-04-25T09:30:41.119277+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:41.119277+0000","last_undegraded":"2024-04-25T09:30:41.119277+0000","last_fullsized":"2024-04-25T09:30:41.119277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"27'543","reported_seq":556,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:42.404125+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:42.404125+0000","last_peered":"2024-04-25T09:30:42.404125+0000","last_clean":"2024-04-25T09:30:42.404125+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:42.404125+0000","last_undegraded":"2024-04-25T09:30:42.404125+0000","last_fullsized":"2024-04-25T09:30:42.404125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'710","reported_seq":723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.420335+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:46.420335+0000","last_peered":"2024-04-25T09:30:46.420335+0000","last_clean":"2024-04-25T09:30:46.420335+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:46.420335+0000","last_undegraded":"2024-04-25T09:30:46.420335+0000","last_fullsized":"2024-04-25T09:30:46.420335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824512,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'431","reported_seq":444,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:42.259130+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:42.259130+0000","last_peered":"2024-04-25T09:30:42.259130+0000","last_clean":"2024-04-25T09:30:42.259130+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:42.259130+0000","last_undegraded":"2024-04-25T09:30:42.259130+0000","last_fullsized":"2024-04-25T09:30:42.259130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"28'536","reported_seq":556,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.410773+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:46.410773+0000","last_peered":"2024-04-25T09:30:46.410773+0000","last_clean":"2024-04-25T09:30:46.410773+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:46.410773+0000","last_undegraded":"2024-04-25T09:30:46.410773+0000","last_fullsized":"2024-04-25T09:30:46.410773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"27'583","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.279716+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:45.279716+0000","last_peered":"2024-04-25T09:30:45.279716+0000","last_clean":"2024-04-25T09:30:45.279716+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:45.279716+0000","last_undegraded":"2024-04-25T09:30:45.279716+0000","last_fullsized":"2024-04-25T09:30:45.279716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"27'535","reported_seq":548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.022295+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:46.022295+0000","last_peered":"2024-04-25T09:30:46.022295+0000","last_clean":"2024-04-25T09:30:46.022295+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:46.022295+0000","last_undegraded":"2024-04-25T09:30:46.022295+0000","last_fullsized":"2024-04-25T09:30:46.022295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"27'498","reported_seq":511,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.347859+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:46.347859+0000","last_peered":"2024-04-25T09:30:46.347859+0000","last_clean":"2024-04-25T09:30:46.347859+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:46.347859+0000","last_undegraded":"2024-04-25T09:30:46.347859+0000","last_fullsized":"2024-04-25T09:30:46.347859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4087808,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":3992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'591","reported_seq":604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.302390+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:46.302390+0000","last_peered":"2024-04-25T09:30:46.302390+0000","last_clean":"2024-04-25T09:30:46.302390+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:46.302390+0000","last_undegraded":"2024-04-25T09:30:46.302390+0000","last_fullsized":"2024-04-25T09:30:46.302390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.016749+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:29:49.016749+0000","last_peered":"2024-04-25T09:29:49.016749+0000","last_clean":"2024-04-25T09:29:49.016749+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:29:49.016749+0000","last_undegraded":"2024-04-25T09:29:49.016749+0000","last_fullsized":"2024-04-25T09:29:49.016749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.423238+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:29:48.423238+0000","last_peered":"2024-04-25T09:29:48.423238+0000","last_clean":"2024-04-25T09:29:48.423238+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:29:48.423238+0000","last_undegraded":"2024-04-25T09:29:48.423238+0000","last_fullsized":"2024-04-25T09:29:48.423238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"28'560","reported_seq":579,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.390938+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:46.390938+0000","last_peered":"2024-04-25T09:30:46.390938+0000","last_clean":"2024-04-25T09:30:46.390938+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:46.390938+0000","last_undegraded":"2024-04-25T09:30:46.390938+0000","last_fullsized":"2024-04-25T09:30:46.390938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.397600+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:30:46.397600+0000","last_peered":"2024-04-25T09:30:46.397600+0000","last_clean":"2024-04-25T09:30:46.397600+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:30:46.397600+0000","last_undegraded":"2024-04-25T09:30:46.397600+0000","last_fullsized":"2024-04-25T09:30:46.397600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'431","reported_seq":444,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:41.758068+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:41.758068+0000","last_peered":"2024-04-25T09:30:41.758068+0000","last_clean":"2024-04-25T09:30:41.758068+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:41.758068+0000","last_undegraded":"2024-04-25T09:30:41.758068+0000","last_fullsized":"2024-04-25T09:30:41.758068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.420878+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:29:48.420878+0000","last_peered":"2024-04-25T09:29:48.420878+0000","last_clean":"2024-04-25T09:29:48.420878+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:29:48.420878+0000","last_undegraded":"2024-04-25T09:29:48.420878+0000","last_fullsized":"2024-04-25T09:29:48.420878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"27'479","reported_seq":492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:40.983835+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:40.983835+0000","last_peered":"2024-04-25T09:30:40.983835+0000","last_clean":"2024-04-25T09:30:40.983835+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:40.983835+0000","last_undegraded":"2024-04-25T09:30:40.983835+0000","last_fullsized":"2024-04-25T09:30:40.983835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.398780+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:30:46.398780+0000","last_peered":"2024-04-25T09:30:46.398780+0000","last_clean":"2024-04-25T09:30:46.398780+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:30:46.398780+0000","last_undegraded":"2024-04-25T09:30:46.398780+0000","last_fullsized":"2024-04-25T09:30:46.398780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"27'583","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.753123+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:45.753123+0000","last_peered":"2024-04-25T09:30:45.753123+0000","last_clean":"2024-04-25T09:30:45.753123+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:45.753123+0000","last_undegraded":"2024-04-25T09:30:45.753123+0000","last_fullsized":"2024-04-25T09:30:45.753123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.706576+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:29:48.706576+0000","last_peered":"2024-04-25T09:29:48.706576+0000","last_clean":"2024-04-25T09:29:48.706576+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:29:48.706576+0000","last_undegraded":"2024-04-25T09:29:48.706576+0000","last_fullsized":"2024-04-25T09:29:48.706576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"28'536","reported_seq":555,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.385871+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:46.385871+0000","last_peered":"2024-04-25T09:30:46.385871+0000","last_clean":"2024-04-25T09:30:46.385871+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:46.385871+0000","last_undegraded":"2024-04-25T09:30:46.385871+0000","last_fullsized":"2024-04-25T09:30:46.385871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.024898+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:29:49.024898+0000","last_peered":"2024-04-25T09:29:49.024898+0000","last_clean":"2024-04-25T09:29:49.024898+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:29:49.024898+0000","last_undegraded":"2024-04-25T09:29:49.024898+0000","last_fullsized":"2024-04-25T09:29:49.024898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"28'616","reported_seq":635,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.397618+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:46.397618+0000","last_peered":"2024-04-25T09:30:46.397618+0000","last_clean":"2024-04-25T09:30:46.397618+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:46.397618+0000","last_undegraded":"2024-04-25T09:30:46.397618+0000","last_fullsized":"2024-04-25T09:30:46.397618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.718138+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:29:48.718138+0000","last_peered":"2024-04-25T09:29:48.718138+0000","last_clean":"2024-04-25T09:29:48.718138+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:29:48.718138+0000","last_undegraded":"2024-04-25T09:29:48.718138+0000","last_fullsized":"2024-04-25T09:29:48.718138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"27'487","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.102419+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:46.102419+0000","last_peered":"2024-04-25T09:30:46.102419+0000","last_clean":"2024-04-25T09:30:46.102419+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:46.102419+0000","last_undegraded":"2024-04-25T09:30:46.102419+0000","last_fullsized":"2024-04-25T09:30:46.102419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.441358+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:29:48.441358+0000","last_peered":"2024-04-25T09:29:48.441358+0000","last_clean":"2024-04-25T09:29:48.441358+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:29:48.441358+0000","last_undegraded":"2024-04-25T09:29:48.441358+0000","last_fullsized":"2024-04-25T09:29:48.441358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":71393280,"num_objects":1091,"num_object_clones":0,"num_object_copies":3273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8715,"num_write_kb":69720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106115072,"data_stored":212230144,"data_compressed":10955331,"data_compressed_allocated":106115072,"data_compressed_original":212230144,"omap_allocated":0,"internal_metadata":0},"log_size":8702,"ondisk_log_size":8702,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83900,"kb_used_data":26548,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94287940,"statfs":{"total":96636764160,"available":96550850560,"internally_reserved":0,"allocated":27185152,"data_stored":54452718,"data_compressed":2806511,"data_compressed_allocated":26935296,"data_compressed_original":54362112,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78756,"kb_used_data":21404,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94293084,"statfs":{"total":96636764160,"available":96556118016,"internally_reserved":0,"allocated":21917696,"data_stored":43917806,"data_compressed":2262683,"data_compressed_allocated":21667840,"data_compressed_original":43827200,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81976,"kb_used_data":28784,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94289864,"statfs":{"total":96636764160,"available":96552820736,"internally_reserved":0,"allocated":29474816,"data_stored":58564558,"data_compressed":3019366,"data_compressed_allocated":29245440,"data_compressed_original":58490880,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71424,"kb_used_data":26548,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94300416,"statfs":{"total":96636764160,"available":96563625984,"internally_reserved":0,"allocated":27185152,"data_stored":54439579,"data_compressed":2805661,"data_compressed_allocated":26927104,"data_compressed_original":54345728,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":54476800,"data_compressed":2812072,"data_compressed_allocated":27238400,"data_compressed_original":54476800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29659136,"data_stored":59318272,"data_compressed":3062089,"data_compressed_allocated":29659136,"data_compressed_original":59318272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":43810816,"data_compressed":2261480,"data_compressed_allocated":21905408,"data_compressed_original":43810816,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":54624256,"data_compressed":2819690,"data_compressed_allocated":27312128,"data_compressed_original":54624256,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:47.719 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:47.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:47.925+0000 7fa390657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:47.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:47.936+0000 7fa390657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.144 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:48.145 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:48.166 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-04-25T09:30:47.353993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":71983648,"num_objects":1093,"num_object_clones":0,"num_object_copies":3279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8852,"num_write_kb":71614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8799,"ondisk_log_size":8799,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":316056,"kb_used_data":103284,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377171304,"statfs":{"total":386547056640,"available":386223415296,"internally_reserved":0,"allocated":105762816,"data_stored":211374661,"data_compressed":10894221,"data_compressed_allocated":104775680,"data_compressed_original":211025920,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3891200,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":3800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.091559"},"pg_stats":[{"pgid":"4.f","version":"27'583","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:41.119277+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:41.119277+0000","last_peered":"2024-04-25T09:30:41.119277+0000","last_clean":"2024-04-25T09:30:41.119277+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:41.119277+0000","last_undegraded":"2024-04-25T09:30:41.119277+0000","last_fullsized":"2024-04-25T09:30:41.119277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"27'543","reported_seq":556,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:42.404125+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:42.404125+0000","last_peered":"2024-04-25T09:30:42.404125+0000","last_clean":"2024-04-25T09:30:42.404125+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:42.404125+0000","last_undegraded":"2024-04-25T09:30:42.404125+0000","last_fullsized":"2024-04-25T09:30:42.404125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"27'710","reported_seq":723,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.420335+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:46.420335+0000","last_peered":"2024-04-25T09:30:46.420335+0000","last_clean":"2024-04-25T09:30:46.420335+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:46.420335+0000","last_undegraded":"2024-04-25T09:30:46.420335+0000","last_fullsized":"2024-04-25T09:30:46.420335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5824512,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'431","reported_seq":444,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:42.259130+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:42.259130+0000","last_peered":"2024-04-25T09:30:42.259130+0000","last_clean":"2024-04-25T09:30:42.259130+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:42.259130+0000","last_undegraded":"2024-04-25T09:30:42.259130+0000","last_fullsized":"2024-04-25T09:30:42.259130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"28'536","reported_seq":556,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.410773+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:46.410773+0000","last_peered":"2024-04-25T09:30:46.410773+0000","last_clean":"2024-04-25T09:30:46.410773+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:46.410773+0000","last_undegraded":"2024-04-25T09:30:46.410773+0000","last_fullsized":"2024-04-25T09:30:46.410773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4399104,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"27'583","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.279716+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:45.279716+0000","last_peered":"2024-04-25T09:30:45.279716+0000","last_clean":"2024-04-25T09:30:45.279716+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:45.279716+0000","last_undegraded":"2024-04-25T09:30:45.279716+0000","last_fullsized":"2024-04-25T09:30:45.279716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"27'535","reported_seq":548,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.022295+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:46.022295+0000","last_peered":"2024-04-25T09:30:46.022295+0000","last_clean":"2024-04-25T09:30:46.022295+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:46.022295+0000","last_undegraded":"2024-04-25T09:30:46.022295+0000","last_fullsized":"2024-04-25T09:30:46.022295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"27'498","reported_seq":511,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.347859+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:46.347859+0000","last_peered":"2024-04-25T09:30:46.347859+0000","last_clean":"2024-04-25T09:30:46.347859+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:46.347859+0000","last_undegraded":"2024-04-25T09:30:46.347859+0000","last_fullsized":"2024-04-25T09:30:46.347859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4087808,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":499,"num_write_kb":3992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'591","reported_seq":604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.302390+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:46.302390+0000","last_peered":"2024-04-25T09:30:46.302390+0000","last_clean":"2024-04-25T09:30:46.302390+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:46.302390+0000","last_undegraded":"2024-04-25T09:30:46.302390+0000","last_fullsized":"2024-04-25T09:30:46.302390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.016749+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:29:49.016749+0000","last_peered":"2024-04-25T09:29:49.016749+0000","last_clean":"2024-04-25T09:29:49.016749+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:29:49.016749+0000","last_undegraded":"2024-04-25T09:29:49.016749+0000","last_fullsized":"2024-04-25T09:29:49.016749+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.423238+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:29:48.423238+0000","last_peered":"2024-04-25T09:29:48.423238+0000","last_clean":"2024-04-25T09:29:48.423238+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:29:48.423238+0000","last_undegraded":"2024-04-25T09:29:48.423238+0000","last_fullsized":"2024-04-25T09:29:48.423238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"28'560","reported_seq":579,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.390938+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:46.390938+0000","last_peered":"2024-04-25T09:30:46.390938+0000","last_clean":"2024-04-25T09:30:46.390938+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:46.390938+0000","last_undegraded":"2024-04-25T09:30:46.390938+0000","last_fullsized":"2024-04-25T09:30:46.390938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.397600+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:30:46.397600+0000","last_peered":"2024-04-25T09:30:46.397600+0000","last_clean":"2024-04-25T09:30:46.397600+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:30:46.397600+0000","last_undegraded":"2024-04-25T09:30:46.397600+0000","last_fullsized":"2024-04-25T09:30:46.397600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"27'431","reported_seq":444,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:41.758068+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:41.758068+0000","last_peered":"2024-04-25T09:30:41.758068+0000","last_clean":"2024-04-25T09:30:41.758068+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:41.758068+0000","last_undegraded":"2024-04-25T09:30:41.758068+0000","last_fullsized":"2024-04-25T09:30:41.758068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.420878+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:29:48.420878+0000","last_peered":"2024-04-25T09:29:48.420878+0000","last_clean":"2024-04-25T09:29:48.420878+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:29:48.420878+0000","last_undegraded":"2024-04-25T09:29:48.420878+0000","last_fullsized":"2024-04-25T09:29:48.420878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"27'479","reported_seq":492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:40.983835+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:40.983835+0000","last_peered":"2024-04-25T09:30:40.983835+0000","last_clean":"2024-04-25T09:30:40.983835+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:40.983835+0000","last_undegraded":"2024-04-25T09:30:40.983835+0000","last_fullsized":"2024-04-25T09:30:40.983835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.398780+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:30:46.398780+0000","last_peered":"2024-04-25T09:30:46.398780+0000","last_clean":"2024-04-25T09:30:46.398780+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:30:46.398780+0000","last_undegraded":"2024-04-25T09:30:46.398780+0000","last_fullsized":"2024-04-25T09:30:46.398780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"27'583","reported_seq":596,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:45.753123+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:45.753123+0000","last_peered":"2024-04-25T09:30:45.753123+0000","last_clean":"2024-04-25T09:30:45.753123+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:45.753123+0000","last_undegraded":"2024-04-25T09:30:45.753123+0000","last_fullsized":"2024-04-25T09:30:45.753123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.706576+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:29:48.706576+0000","last_peered":"2024-04-25T09:29:48.706576+0000","last_clean":"2024-04-25T09:29:48.706576+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:29:48.706576+0000","last_undegraded":"2024-04-25T09:29:48.706576+0000","last_fullsized":"2024-04-25T09:29:48.706576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"28'536","reported_seq":555,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.385871+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:46.385871+0000","last_peered":"2024-04-25T09:30:46.385871+0000","last_clean":"2024-04-25T09:30:46.385871+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:46.385871+0000","last_undegraded":"2024-04-25T09:30:46.385871+0000","last_fullsized":"2024-04-25T09:30:46.385871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:49.024898+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:29:49.024898+0000","last_peered":"2024-04-25T09:29:49.024898+0000","last_clean":"2024-04-25T09:29:49.024898+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:29:49.024898+0000","last_undegraded":"2024-04-25T09:29:49.024898+0000","last_fullsized":"2024-04-25T09:29:49.024898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"28'616","reported_seq":635,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.397618+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:46.397618+0000","last_peered":"2024-04-25T09:30:46.397618+0000","last_clean":"2024-04-25T09:30:46.397618+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:46.397618+0000","last_undegraded":"2024-04-25T09:30:46.397618+0000","last_fullsized":"2024-04-25T09:30:46.397618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.718138+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:29:48.718138+0000","last_peered":"2024-04-25T09:29:48.718138+0000","last_clean":"2024-04-25T09:29:48.718138+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:29:48.718138+0000","last_undegraded":"2024-04-25T09:29:48.718138+0000","last_fullsized":"2024-04-25T09:29:48.718138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"27'487","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:30:46.102419+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:46.102419+0000","last_peered":"2024-04-25T09:30:46.102419+0000","last_clean":"2024-04-25T09:30:46.102419+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:46.102419+0000","last_undegraded":"2024-04-25T09:30:46.102419+0000","last_fullsized":"2024-04-25T09:30:46.102419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T09:29:48.441358+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:29:48.441358+0000","last_peered":"2024-04-25T09:29:48.441358+0000","last_clean":"2024-04-25T09:29:48.441358+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:29:48.441358+0000","last_undegraded":"2024-04-25T09:29:48.441358+0000","last_fullsized":"2024-04-25T09:29:48.441358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":71393280,"num_objects":1091,"num_object_clones":0,"num_object_copies":3273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8715,"num_write_kb":69720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106115072,"data_stored":212230144,"data_compressed":10955331,"data_compressed_allocated":106115072,"data_compressed_original":212230144,"omap_allocated":0,"internal_metadata":0},"log_size":8702,"ondisk_log_size":8702,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83900,"kb_used_data":26548,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94287940,"statfs":{"total":96636764160,"available":96550850560,"internally_reserved":0,"allocated":27185152,"data_stored":54452718,"data_compressed":2806511,"data_compressed_allocated":26935296,"data_compressed_original":54362112,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78756,"kb_used_data":21404,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94293084,"statfs":{"total":96636764160,"available":96556118016,"internally_reserved":0,"allocated":21917696,"data_stored":43917806,"data_compressed":2262683,"data_compressed_allocated":21667840,"data_compressed_original":43827200,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81976,"kb_used_data":28784,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94289864,"statfs":{"total":96636764160,"available":96552820736,"internally_reserved":0,"allocated":29474816,"data_stored":58564558,"data_compressed":3019366,"data_compressed_allocated":29245440,"data_compressed_original":58490880,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71424,"kb_used_data":26548,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94300416,"statfs":{"total":96636764160,"available":96563625984,"internally_reserved":0,"allocated":27185152,"data_stored":54439579,"data_compressed":2805661,"data_compressed_allocated":26927104,"data_compressed_original":54345728,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27238400,"data_stored":54476800,"data_compressed":2812072,"data_compressed_allocated":27238400,"data_compressed_original":54476800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29659136,"data_stored":59318272,"data_compressed":3062089,"data_compressed_allocated":29659136,"data_compressed_original":59318272,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21905408,"data_stored":43810816,"data_compressed":2261480,"data_compressed_allocated":21905408,"data_compressed_original":43810816,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27312128,"data_stored":54624256,"data_compressed":2819690,"data_compressed_allocated":27312128,"data_compressed_original":54624256,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:48.167 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:30:48.167 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:48.167 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:30:48.168 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:30:48.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.319+0000 7f1f5eaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.330+0000 7f1f5eaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.340 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:48.340 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:48.340 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:48.340 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:48.340 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:48.340 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:48.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:48.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:48.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:48.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:48.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:48.341 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:48.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:48.345 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:48.345 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:30:48.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:30:48.405427+0000 min lat: 0.0143996 max lat: 0.390003 avg lat: 0.104796 2024-04-25T09:30:48.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:30:48.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 9166 9150 1.1913 1.03125 0.0316441 0.104796 2024-04-25T09:30:48.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.501+0000 7f762f86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.516+0000 7f762f86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.539 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:48.539 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:48.539 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:48.539 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:48.539 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:48.543 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:48.543 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:48.543 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:30:48.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.741+0000 7feadd4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.756+0000 7feadd4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:48.760 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:48.761 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:48.761 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:48.761 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:48.761 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:48.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:48.766 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:48.766 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:30:48.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.936+0000 7f28fe0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.935 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:48.950+0000 7f28fe0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:48.963 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:30:48.963 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:30:48.963 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:30:48.963 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:30:48.963 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:30:48.963 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:30:48.963 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:30:48.964 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:30:48.964 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:30:48.964 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:30:48.964 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:30:48.964 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:30:48.964 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:48.967 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:30:48.967 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:30:49.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:49.114+0000 7f1c2019d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:49.122+0000 7f1c2019d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:49.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 9304 9288 1.18944 1.07812 0.0424086 0.104967 2024-04-25T09:30:50.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 9446 9430 1.18815 1.10938 0.0758032 0.10507 2024-04-25T09:30:51.310 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:51.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 9586 9570 1.18665 1.09375 0.0576919 0.105222 2024-04-25T09:30:51.449 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:51.462+0000 7f9f54420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:51.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:51.470+0000 7f9f54420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:52.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 9728 9712 1.18544 1.10938 0.0760281 0.105325 2024-04-25T09:30:53.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 9879 9863 1.18535 1.17969 0.033523 0.105321 2024-04-25T09:30:53.698 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:53.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:53.859+0000 7f091f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:53.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:53.868+0000 7f091f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:53.968 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:53.968 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:53.968 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:54.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:54.118+0000 7f4fca1c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:54.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:54.129+0000 7f4fca1c6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:54.330 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:54.331 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:54.348 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-04-25T09:30:53.264606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79577632,"num_objects":1209,"num_object_clones":0,"num_object_copies":3627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9779,"num_write_kb":79030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9723,"ondisk_log_size":9723,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":307424,"kb_used_data":115452,"kb_used_omap":0,"kb_used_meta":191936,"kb_avail":377179936,"statfs":{"total":386547056640,"available":386232254464,"internally_reserved":0,"allocated":118222848,"data_stored":236097640,"data_compressed":12168297,"data_compressed_allocated":117112832,"data_compressed_original":235700224,"omap_allocated":0,"internal_metadata":196542464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11485184,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1402,"num_write_kb":11216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.922578"},"pg_stats":[{"pgid":"4.f","version":"31'664","reported_seq":685,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.879936+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:50.879936+0000","last_peered":"2024-04-25T09:30:50.879936+0000","last_clean":"2024-04-25T09:30:50.879936+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:50.879936+0000","last_undegraded":"2024-04-25T09:30:50.879936+0000","last_fullsized":"2024-04-25T09:30:50.879936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5447680,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":665,"num_write_kb":5320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"31'663","reported_seq":684,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.655522+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:51.655522+0000","last_peered":"2024-04-25T09:30:51.655522+0000","last_clean":"2024-04-25T09:30:51.655522+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:51.655522+0000","last_undegraded":"2024-04-25T09:30:51.655522+0000","last_fullsized":"2024-04-25T09:30:51.655522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'759","reported_seq":782,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.148566+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:51.148566+0000","last_peered":"2024-04-25T09:30:51.148566+0000","last_clean":"2024-04-25T09:30:51.148566+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:51.148566+0000","last_undegraded":"2024-04-25T09:30:51.148566+0000","last_fullsized":"2024-04-25T09:30:51.148566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'548","reported_seq":571,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:52.415338+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:52.415338+0000","last_peered":"2024-04-25T09:30:52.415338+0000","last_clean":"2024-04-25T09:30:52.415338+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:52.415338+0000","last_undegraded":"2024-04-25T09:30:52.415338+0000","last_fullsized":"2024-04-25T09:30:52.415338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"31'583","reported_seq":606,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.427068+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:51.427068+0000","last_peered":"2024-04-25T09:30:51.427068+0000","last_clean":"2024-04-25T09:30:51.427068+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:51.427068+0000","last_undegraded":"2024-04-25T09:30:51.427068+0000","last_fullsized":"2024-04-25T09:30:51.427068+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"31'623","reported_seq":646,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.198771+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:51.198771+0000","last_peered":"2024-04-25T09:30:51.198771+0000","last_clean":"2024-04-25T09:30:51.198771+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:51.198771+0000","last_undegraded":"2024-04-25T09:30:51.198771+0000","last_fullsized":"2024-04-25T09:30:51.198771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"31'575","reported_seq":598,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.957503+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:50.957503+0000","last_peered":"2024-04-25T09:30:50.957503+0000","last_clean":"2024-04-25T09:30:50.957503+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:50.957503+0000","last_undegraded":"2024-04-25T09:30:50.957503+0000","last_fullsized":"2024-04-25T09:30:50.957503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"31'540","reported_seq":563,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.384115+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:51.384115+0000","last_peered":"2024-04-25T09:30:51.384115+0000","last_clean":"2024-04-25T09:30:51.384115+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:51.384115+0000","last_undegraded":"2024-04-25T09:30:51.384115+0000","last_fullsized":"2024-04-25T09:30:51.384115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4431872,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":541,"num_write_kb":4328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'615","reported_seq":638,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.018621+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:51.018621+0000","last_peered":"2024-04-25T09:30:51.018621+0000","last_clean":"2024-04-25T09:30:51.018621+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:51.018621+0000","last_undegraded":"2024-04-25T09:30:51.018621+0000","last_fullsized":"2024-04-25T09:30:51.018621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.382117+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:30:47.382117+0000","last_peered":"2024-04-25T09:30:47.382117+0000","last_clean":"2024-04-25T09:30:47.382117+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:30:47.382117+0000","last_undegraded":"2024-04-25T09:30:47.382117+0000","last_fullsized":"2024-04-25T09:30:47.382117+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.459456+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:30:47.459456+0000","last_peered":"2024-04-25T09:30:47.459456+0000","last_clean":"2024-04-25T09:30:47.459456+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:30:47.459456+0000","last_undegraded":"2024-04-25T09:30:47.459456+0000","last_fullsized":"2024-04-25T09:30:47.459456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"31'599","reported_seq":622,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.347877+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:51.347877+0000","last_peered":"2024-04-25T09:30:51.347877+0000","last_clean":"2024-04-25T09:30:51.347877+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:51.347877+0000","last_undegraded":"2024-04-25T09:30:51.347877+0000","last_fullsized":"2024-04-25T09:30:51.347877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.455737+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:30:47.455737+0000","last_peered":"2024-04-25T09:30:47.455737+0000","last_clean":"2024-04-25T09:30:47.455737+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:30:47.455737+0000","last_undegraded":"2024-04-25T09:30:47.455737+0000","last_fullsized":"2024-04-25T09:30:47.455737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'527","reported_seq":548,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:52.140456+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:52.140456+0000","last_peered":"2024-04-25T09:30:52.140456+0000","last_clean":"2024-04-25T09:30:52.140456+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:52.140456+0000","last_undegraded":"2024-04-25T09:30:52.140456+0000","last_fullsized":"2024-04-25T09:30:52.140456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.447740+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:30:47.447740+0000","last_peered":"2024-04-25T09:30:47.447740+0000","last_clean":"2024-04-25T09:30:47.447740+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:30:47.447740+0000","last_undegraded":"2024-04-25T09:30:47.447740+0000","last_fullsized":"2024-04-25T09:30:47.447740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"31'550","reported_seq":571,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:52.402628+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:52.402628+0000","last_peered":"2024-04-25T09:30:52.402628+0000","last_clean":"2024-04-25T09:30:52.402628+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:52.402628+0000","last_undegraded":"2024-04-25T09:30:52.402628+0000","last_fullsized":"2024-04-25T09:30:52.402628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4513792,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":551,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.452503+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:30:47.452503+0000","last_peered":"2024-04-25T09:30:47.452503+0000","last_clean":"2024-04-25T09:30:47.452503+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:30:47.452503+0000","last_undegraded":"2024-04-25T09:30:47.452503+0000","last_fullsized":"2024-04-25T09:30:47.452503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"31'623","reported_seq":646,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:51.267886+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:51.267886+0000","last_peered":"2024-04-25T09:30:51.267886+0000","last_clean":"2024-04-25T09:30:51.267886+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:51.267886+0000","last_undegraded":"2024-04-25T09:30:51.267886+0000","last_fullsized":"2024-04-25T09:30:51.267886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.448068+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:30:47.448068+0000","last_peered":"2024-04-25T09:30:47.448068+0000","last_clean":"2024-04-25T09:30:47.448068+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:30:47.448068+0000","last_undegraded":"2024-04-25T09:30:47.448068+0000","last_fullsized":"2024-04-25T09:30:47.448068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"31'575","reported_seq":598,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.920717+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:50.920717+0000","last_peered":"2024-04-25T09:30:50.920717+0000","last_clean":"2024-04-25T09:30:50.920717+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:50.920717+0000","last_undegraded":"2024-04-25T09:30:50.920717+0000","last_fullsized":"2024-04-25T09:30:50.920717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.388267+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:30:47.388267+0000","last_peered":"2024-04-25T09:30:47.388267+0000","last_clean":"2024-04-25T09:30:47.388267+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:30:47.388267+0000","last_undegraded":"2024-04-25T09:30:47.388267+0000","last_fullsized":"2024-04-25T09:30:47.388267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'663","reported_seq":686,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:49.360746+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:49.360746+0000","last_peered":"2024-04-25T09:30:49.360746+0000","last_clean":"2024-04-25T09:30:49.360746+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:49.360746+0000","last_undegraded":"2024-04-25T09:30:49.360746+0000","last_fullsized":"2024-04-25T09:30:49.360746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.464407+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:30:47.464407+0000","last_peered":"2024-04-25T09:30:47.464407+0000","last_clean":"2024-04-25T09:30:47.464407+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:30:47.464407+0000","last_undegraded":"2024-04-25T09:30:47.464407+0000","last_fullsized":"2024-04-25T09:30:47.464407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"31'519","reported_seq":542,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:50.192930+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:50.192930+0000","last_peered":"2024-04-25T09:30:50.192930+0000","last_clean":"2024-04-25T09:30:50.192930+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:50.192930+0000","last_undegraded":"2024-04-25T09:30:50.192930+0000","last_fullsized":"2024-04-25T09:30:50.192930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.476718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:30:47.476718+0000","last_peered":"2024-04-25T09:30:47.476718+0000","last_clean":"2024-04-25T09:30:47.476718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:30:47.476718+0000","last_undegraded":"2024-04-25T09:30:47.476718+0000","last_fullsized":"2024-04-25T09:30:47.476718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":78987264,"num_objects":1207,"num_object_clones":0,"num_object_copies":3621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9642,"num_write_kb":77136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118505472,"data_stored":237010944,"data_compressed":12234906,"data_compressed_allocated":118505472,"data_compressed_original":237010944,"omap_allocated":0,"internal_metadata":0},"log_size":9626,"ondisk_log_size":9626,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75912,"kb_used_data":31036,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94295928,"statfs":{"total":96636764160,"available":96559030272,"internally_reserved":0,"allocated":31780864,"data_stored":63591586,"data_compressed":3277733,"data_compressed_allocated":31498240,"data_compressed_original":63488000,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69744,"kb_used_data":24872,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94302096,"statfs":{"total":96636764160,"available":96565346304,"internally_reserved":0,"allocated":25468928,"data_stored":50967714,"data_compressed":2626040,"data_compressed_allocated":25186304,"data_compressed_original":50864128,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84264,"kb_used_data":31072,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94287576,"statfs":{"total":96636764160,"available":96550477824,"internally_reserved":0,"allocated":31817728,"data_stored":63197826,"data_compressed":3257938,"data_compressed_allocated":31555584,"data_compressed_original":63111168,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77504,"kb_used_data":28472,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294336,"statfs":{"total":96636764160,"available":96557400064,"internally_reserved":0,"allocated":29155328,"data_stored":58340514,"data_compressed":3006586,"data_compressed_allocated":28872704,"data_compressed_original":58236928,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29249536,"data_stored":58499072,"data_compressed":3019765,"data_compressed_allocated":29249536,"data_compressed_original":58499072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31944704,"data_stored":63889408,"data_compressed":3298123,"data_compressed_allocated":31944704,"data_compressed_original":63889408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25440256,"data_stored":50880512,"data_compressed":2626529,"data_compressed_allocated":25440256,"data_compressed_original":50880512,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31870976,"data_stored":63741952,"data_compressed":3290489,"data_compressed_allocated":31870976,"data_compressed_original":63741952,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:30:54.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 15 10020 10005 1.1842 1.10938 0.121119 0.105469 2024-04-25T09:30:55.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 10165 10149 1.18331 1.125 0.025475 0.10554 2024-04-25T09:30:56.016 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:30:56.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:56.193+0000 7fa44586d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:56.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:56.201+0000 7fa44586d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:56.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 10308 10292 1.18234 1.11719 0.126931 0.105567 2024-04-25T09:30:57.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 10457 10441 1.18207 1.16406 0.0801616 0.10561 2024-04-25T09:30:58.384 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:30:58.389 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 10601 10585 1.18126 1.125 0.097308 0.10569 2024-04-25T09:30:58.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:58.521+0000 7f9e27e64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:58.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:58.530+0000 7f9e27e64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:59.350 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:30:59.350 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:30:59.350 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:30:59.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 10729 10713 1.1787 1 0.125375 0.105947 2024-04-25T09:30:59.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:59.505+0000 7fb03ff5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:59.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:30:59.516+0000 7fb03ff5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:30:59.776 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:30:59.776 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:30:59.795 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-04-25T09:30:59.265883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":85443104,"num_objects":1298,"num_object_clones":0,"num_object_copies":3894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10495,"num_write_kb":84758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10439,"ondisk_log_size":10439,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":328660,"kb_used_data":124212,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377158700,"statfs":{"total":386547056640,"available":386210508800,"internally_reserved":0,"allocated":127193088,"data_stored":254038120,"data_compressed":13094667,"data_compressed_allocated":126083072,"data_compressed_original":253640704,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13459456,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1643,"num_write_kb":13144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.911890"},"pg_stats":[{"pgid":"4.f","version":"31'711","reported_seq":732,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:57.109122+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:30:57.109122+0000","last_peered":"2024-04-25T09:30:57.109122+0000","last_clean":"2024-04-25T09:30:57.109122+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:30:57.109122+0000","last_undegraded":"2024-04-25T09:30:57.109122+0000","last_fullsized":"2024-04-25T09:30:57.109122+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"31'695","reported_seq":716,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:55.134252+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:30:55.134252+0000","last_peered":"2024-04-25T09:30:55.134252+0000","last_clean":"2024-04-25T09:30:55.134252+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:30:55.134252+0000","last_undegraded":"2024-04-25T09:30:55.134252+0000","last_fullsized":"2024-04-25T09:30:55.134252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'815","reported_seq":838,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:55.194877+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:30:55.194877+0000","last_peered":"2024-04-25T09:30:55.194877+0000","last_clean":"2024-04-25T09:30:55.194877+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:30:55.194877+0000","last_undegraded":"2024-04-25T09:30:55.194877+0000","last_fullsized":"2024-04-25T09:30:55.194877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'639","reported_seq":662,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:57.417738+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:30:57.417738+0000","last_peered":"2024-04-25T09:30:57.417738+0000","last_clean":"2024-04-25T09:30:57.417738+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:30:57.417738+0000","last_undegraded":"2024-04-25T09:30:57.417738+0000","last_fullsized":"2024-04-25T09:30:57.417738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"31'615","reported_seq":638,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:55.840097+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:55.840097+0000","last_peered":"2024-04-25T09:30:55.840097+0000","last_clean":"2024-04-25T09:30:55.840097+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:55.840097+0000","last_undegraded":"2024-04-25T09:30:55.840097+0000","last_fullsized":"2024-04-25T09:30:55.840097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"31'682","reported_seq":705,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:56.410509+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:30:56.410509+0000","last_peered":"2024-04-25T09:30:56.410509+0000","last_clean":"2024-04-25T09:30:56.410509+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:30:56.410509+0000","last_undegraded":"2024-04-25T09:30:56.410509+0000","last_fullsized":"2024-04-25T09:30:56.410509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5595136,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":5464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"31'631","reported_seq":654,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:56.409212+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:30:56.409212+0000","last_peered":"2024-04-25T09:30:56.409212+0000","last_clean":"2024-04-25T09:30:56.409212+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:30:56.409212+0000","last_undegraded":"2024-04-25T09:30:56.409212+0000","last_fullsized":"2024-04-25T09:30:56.409212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"31'567","reported_seq":590,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:55.976022+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:30:55.976022+0000","last_peered":"2024-04-25T09:30:55.976022+0000","last_clean":"2024-04-25T09:30:55.976022+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:30:55.976022+0000","last_undegraded":"2024-04-25T09:30:55.976022+0000","last_fullsized":"2024-04-25T09:30:55.976022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'631","reported_seq":654,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:55.703001+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:30:55.703001+0000","last_peered":"2024-04-25T09:30:55.703001+0000","last_clean":"2024-04-25T09:30:55.703001+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:30:55.703001+0000","last_undegraded":"2024-04-25T09:30:55.703001+0000","last_fullsized":"2024-04-25T09:30:55.703001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.382117+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:30:47.382117+0000","last_peered":"2024-04-25T09:30:47.382117+0000","last_clean":"2024-04-25T09:30:47.382117+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:30:47.382117+0000","last_undegraded":"2024-04-25T09:30:47.382117+0000","last_fullsized":"2024-04-25T09:30:47.382117+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.459456+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:30:47.459456+0000","last_peered":"2024-04-25T09:30:47.459456+0000","last_clean":"2024-04-25T09:30:47.459456+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:30:47.459456+0000","last_undegraded":"2024-04-25T09:30:47.459456+0000","last_fullsized":"2024-04-25T09:30:47.459456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"31'679","reported_seq":702,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:56.306327+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:56.306327+0000","last_peered":"2024-04-25T09:30:56.306327+0000","last_clean":"2024-04-25T09:30:56.306327+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:56.306327+0000","last_undegraded":"2024-04-25T09:30:56.306327+0000","last_fullsized":"2024-04-25T09:30:56.306327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.455737+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:30:47.455737+0000","last_peered":"2024-04-25T09:30:47.455737+0000","last_clean":"2024-04-25T09:30:47.455737+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:30:47.455737+0000","last_undegraded":"2024-04-25T09:30:47.455737+0000","last_fullsized":"2024-04-25T09:30:47.455737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'567","reported_seq":588,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:56.985020+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:30:56.985020+0000","last_peered":"2024-04-25T09:30:56.985020+0000","last_clean":"2024-04-25T09:30:56.985020+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:30:56.985020+0000","last_undegraded":"2024-04-25T09:30:56.985020+0000","last_fullsized":"2024-04-25T09:30:56.985020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.447740+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:30:47.447740+0000","last_peered":"2024-04-25T09:30:47.447740+0000","last_clean":"2024-04-25T09:30:47.447740+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:30:47.447740+0000","last_undegraded":"2024-04-25T09:30:47.447740+0000","last_fullsized":"2024-04-25T09:30:47.447740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"31'611","reported_seq":632,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:57.394884+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:30:57.394884+0000","last_peered":"2024-04-25T09:30:57.394884+0000","last_clean":"2024-04-25T09:30:57.394884+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:30:57.394884+0000","last_undegraded":"2024-04-25T09:30:57.394884+0000","last_fullsized":"2024-04-25T09:30:57.394884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5013504,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.452503+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:30:47.452503+0000","last_peered":"2024-04-25T09:30:47.452503+0000","last_clean":"2024-04-25T09:30:47.452503+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:30:47.452503+0000","last_undegraded":"2024-04-25T09:30:47.452503+0000","last_fullsized":"2024-04-25T09:30:47.452503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"31'647","reported_seq":670,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:55.570505+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:55.570505+0000","last_peered":"2024-04-25T09:30:55.570505+0000","last_clean":"2024-04-25T09:30:55.570505+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:55.570505+0000","last_undegraded":"2024-04-25T09:30:55.570505+0000","last_fullsized":"2024-04-25T09:30:55.570505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.448068+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:30:47.448068+0000","last_peered":"2024-04-25T09:30:47.448068+0000","last_clean":"2024-04-25T09:30:47.448068+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:30:47.448068+0000","last_undegraded":"2024-04-25T09:30:47.448068+0000","last_fullsized":"2024-04-25T09:30:47.448068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"31'583","reported_seq":606,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:52.510320+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:30:52.510320+0000","last_peered":"2024-04-25T09:30:52.510320+0000","last_clean":"2024-04-25T09:30:52.510320+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:30:52.510320+0000","last_undegraded":"2024-04-25T09:30:52.510320+0000","last_fullsized":"2024-04-25T09:30:52.510320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.388267+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:30:47.388267+0000","last_peered":"2024-04-25T09:30:47.388267+0000","last_clean":"2024-04-25T09:30:47.388267+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:30:47.388267+0000","last_undegraded":"2024-04-25T09:30:47.388267+0000","last_fullsized":"2024-04-25T09:30:47.388267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'718","reported_seq":741,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:56.401961+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:30:56.401961+0000","last_peered":"2024-04-25T09:30:56.401961+0000","last_clean":"2024-04-25T09:30:56.401961+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:30:56.401961+0000","last_undegraded":"2024-04-25T09:30:56.401961+0000","last_fullsized":"2024-04-25T09:30:56.401961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5890048,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":5752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.464407+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:30:47.464407+0000","last_peered":"2024-04-25T09:30:47.464407+0000","last_clean":"2024-04-25T09:30:47.464407+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:30:47.464407+0000","last_undegraded":"2024-04-25T09:30:47.464407+0000","last_fullsized":"2024-04-25T09:30:47.464407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"31'551","reported_seq":574,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:54.912714+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:30:54.912714+0000","last_peered":"2024-04-25T09:30:54.912714+0000","last_clean":"2024-04-25T09:30:54.912714+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:30:54.912714+0000","last_undegraded":"2024-04-25T09:30:54.912714+0000","last_fullsized":"2024-04-25T09:30:54.912714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.476718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:30:47.476718+0000","last_peered":"2024-04-25T09:30:47.476718+0000","last_clean":"2024-04-25T09:30:47.476718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:30:47.476718+0000","last_undegraded":"2024-04-25T09:30:47.476718+0000","last_fullsized":"2024-04-25T09:30:47.476718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":84852736,"num_objects":1296,"num_object_clones":0,"num_object_copies":3888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10358,"num_write_kb":82864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":127381504,"data_stored":254763008,"data_compressed":13151547,"data_compressed_allocated":127381504,"data_compressed_original":254763008,"omap_allocated":0,"internal_metadata":0},"log_size":10342,"ondisk_log_size":10342,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673154,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82612,"kb_used_data":33580,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94289228,"statfs":{"total":96636764160,"available":96552169472,"internally_reserved":0,"allocated":34385920,"data_stored":68801698,"data_compressed":3546761,"data_compressed_allocated":34103296,"data_compressed_original":68698112,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673154,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75684,"kb_used_data":26652,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94296156,"statfs":{"total":96636764160,"available":96559263744,"internally_reserved":0,"allocated":27291648,"data_stored":54613154,"data_compressed":2814275,"data_compressed_allocated":27009024,"data_compressed_original":54509568,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90708,"kb_used_data":33356,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94281132,"statfs":{"total":96636764160,"available":96543879168,"internally_reserved":0,"allocated":34156544,"data_stored":67875458,"data_compressed":3499471,"data_compressed_allocated":33894400,"data_compressed_original":67788800,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79656,"kb_used_data":30624,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94292184,"statfs":{"total":96636764160,"available":96555196416,"internally_reserved":0,"allocated":31358976,"data_stored":62747810,"data_compressed":3234160,"data_compressed_allocated":31076352,"data_compressed_original":62644224,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31465472,"data_stored":62930944,"data_compressed":3248608,"data_compressed_allocated":31465472,"data_compressed_original":62930944,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34234368,"data_stored":68468736,"data_compressed":3534580,"data_compressed_allocated":34234368,"data_compressed_original":68468736,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27258880,"data_stored":54517760,"data_compressed":2814341,"data_compressed_allocated":27258880,"data_compressed_original":54517760,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":68845568,"data_compressed":3554018,"data_compressed_allocated":34422784,"data_compressed_original":68845568,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:00.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 10849 10833 1.17535 0.9375 0.0540476 0.106236 2024-04-25T09:31:00.690 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:00.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:00.837+0000 7f7d82a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:00.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:00.845+0000 7f7d82a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:01.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 10989 10973 1.17423 1.09375 0.0256835 0.10632 2024-04-25T09:31:02.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 11142 11126 1.17452 1.19531 0.131249 0.106342 2024-04-25T09:31:03.114 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:03.263 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:03.275+0000 7f1fd559d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:03.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:03.282+0000 7f1fd559d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:03.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 11283 11267 1.17354 1.10156 0.103252 0.106376 2024-04-25T09:31:04.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 11428 11412 1.173 1.13281 0.0441292 0.106476 2024-04-25T09:31:04.798 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:04.798 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:04.798 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:31:04.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:04.935+0000 7f1c332ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:04.930 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:04.945+0000 7f1c332ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:05.177 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:31:05.177 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:31:05.190 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-04-25T09:31:03.266643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":91013664,"num_objects":1383,"num_object_clones":0,"num_object_copies":4149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11175,"num_write_kb":90198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11119,"ondisk_log_size":11119,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":345212,"kb_used_data":132444,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377142148,"statfs":{"total":386547056640,"available":386193559552,"internally_reserved":0,"allocated":135622656,"data_stored":270897256,"data_compressed":13965201,"data_compressed_allocated":134512640,"data_compressed_original":270499840,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16941056,"num_objects":257,"num_object_clones":0,"num_object_copies":771,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2068,"num_write_kb":16544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002457"},"pg_stats":[{"pgid":"4.f","version":"31'735","reported_seq":756,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.599488+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:31:01.599488+0000","last_peered":"2024-04-25T09:31:01.599488+0000","last_clean":"2024-04-25T09:31:01.599488+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:31:01.599488+0000","last_undegraded":"2024-04-25T09:31:01.599488+0000","last_fullsized":"2024-04-25T09:31:01.599488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"31'735","reported_seq":756,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.928843+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:31:01.928843+0000","last_peered":"2024-04-25T09:31:01.928843+0000","last_clean":"2024-04-25T09:31:01.928843+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:31:01.928843+0000","last_undegraded":"2024-04-25T09:31:01.928843+0000","last_fullsized":"2024-04-25T09:31:01.928843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'863","reported_seq":886,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.110918+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:31:01.110918+0000","last_peered":"2024-04-25T09:31:01.110918+0000","last_clean":"2024-04-25T09:31:01.110918+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:31:01.110918+0000","last_undegraded":"2024-04-25T09:31:01.110918+0000","last_fullsized":"2024-04-25T09:31:01.110918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'663","reported_seq":686,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:02.244445+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:31:02.244445+0000","last_peered":"2024-04-25T09:31:02.244445+0000","last_clean":"2024-04-25T09:31:02.244445+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:31:02.244445+0000","last_undegraded":"2024-04-25T09:31:02.244445+0000","last_fullsized":"2024-04-25T09:31:02.244445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"31'655","reported_seq":678,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:59.669018+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:30:59.669018+0000","last_peered":"2024-04-25T09:30:59.669018+0000","last_clean":"2024-04-25T09:30:59.669018+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:30:59.669018+0000","last_undegraded":"2024-04-25T09:30:59.669018+0000","last_fullsized":"2024-04-25T09:30:59.669018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"31'719","reported_seq":742,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:00.874059+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:31:00.874059+0000","last_peered":"2024-04-25T09:31:00.874059+0000","last_clean":"2024-04-25T09:31:00.874059+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:31:00.874059+0000","last_undegraded":"2024-04-25T09:31:00.874059+0000","last_fullsized":"2024-04-25T09:31:00.874059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"31'667","reported_seq":690,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.383676+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:31:01.383676+0000","last_peered":"2024-04-25T09:31:01.383676+0000","last_clean":"2024-04-25T09:31:01.383676+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:31:01.383676+0000","last_undegraded":"2024-04-25T09:31:01.383676+0000","last_fullsized":"2024-04-25T09:31:01.383676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5472256,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":5344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"31'591","reported_seq":614,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:00.986896+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:31:00.986896+0000","last_peered":"2024-04-25T09:31:00.986896+0000","last_clean":"2024-04-25T09:31:00.986896+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:31:00.986896+0000","last_undegraded":"2024-04-25T09:31:00.986896+0000","last_fullsized":"2024-04-25T09:31:00.986896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'671","reported_seq":694,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.081024+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:31:01.081024+0000","last_peered":"2024-04-25T09:31:01.081024+0000","last_clean":"2024-04-25T09:31:01.081024+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:31:01.081024+0000","last_undegraded":"2024-04-25T09:31:01.081024+0000","last_fullsized":"2024-04-25T09:31:01.081024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.382117+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:30:47.382117+0000","last_peered":"2024-04-25T09:30:47.382117+0000","last_clean":"2024-04-25T09:30:47.382117+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:30:47.382117+0000","last_undegraded":"2024-04-25T09:30:47.382117+0000","last_fullsized":"2024-04-25T09:30:47.382117+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.459456+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:30:47.459456+0000","last_peered":"2024-04-25T09:30:47.459456+0000","last_clean":"2024-04-25T09:30:47.459456+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:30:47.459456+0000","last_undegraded":"2024-04-25T09:30:47.459456+0000","last_fullsized":"2024-04-25T09:30:47.459456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"31'703","reported_seq":726,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:58.259192+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:30:58.259192+0000","last_peered":"2024-04-25T09:30:58.259192+0000","last_clean":"2024-04-25T09:30:58.259192+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:30:58.259192+0000","last_undegraded":"2024-04-25T09:30:58.259192+0000","last_fullsized":"2024-04-25T09:30:58.259192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.455737+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:30:47.455737+0000","last_peered":"2024-04-25T09:30:47.455737+0000","last_clean":"2024-04-25T09:30:47.455737+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:30:47.455737+0000","last_undegraded":"2024-04-25T09:30:47.455737+0000","last_fullsized":"2024-04-25T09:30:47.455737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'639","reported_seq":660,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:02.360425+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:31:02.360425+0000","last_peered":"2024-04-25T09:31:02.360425+0000","last_clean":"2024-04-25T09:31:02.360425+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:31:02.360425+0000","last_undegraded":"2024-04-25T09:31:02.360425+0000","last_fullsized":"2024-04-25T09:31:02.360425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.447740+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:30:47.447740+0000","last_peered":"2024-04-25T09:30:47.447740+0000","last_clean":"2024-04-25T09:30:47.447740+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:30:47.447740+0000","last_undegraded":"2024-04-25T09:30:47.447740+0000","last_fullsized":"2024-04-25T09:30:47.447740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"31'663","reported_seq":684,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:02.067549+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:31:02.067549+0000","last_peered":"2024-04-25T09:31:02.067549+0000","last_clean":"2024-04-25T09:31:02.067549+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:31:02.067549+0000","last_undegraded":"2024-04-25T09:31:02.067549+0000","last_fullsized":"2024-04-25T09:31:02.067549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.452503+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:30:47.452503+0000","last_peered":"2024-04-25T09:30:47.452503+0000","last_clean":"2024-04-25T09:30:47.452503+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:30:47.452503+0000","last_undegraded":"2024-04-25T09:30:47.452503+0000","last_fullsized":"2024-04-25T09:30:47.452503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"31'679","reported_seq":702,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:59.290073+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:30:59.290073+0000","last_peered":"2024-04-25T09:30:59.290073+0000","last_clean":"2024-04-25T09:30:59.290073+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:30:59.290073+0000","last_undegraded":"2024-04-25T09:30:59.290073+0000","last_fullsized":"2024-04-25T09:30:59.290073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.448068+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:30:47.448068+0000","last_peered":"2024-04-25T09:30:47.448068+0000","last_clean":"2024-04-25T09:30:47.448068+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:30:47.448068+0000","last_undegraded":"2024-04-25T09:30:47.448068+0000","last_fullsized":"2024-04-25T09:30:47.448068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"31'618","reported_seq":641,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.404324+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:31:01.404324+0000","last_peered":"2024-04-25T09:31:01.404324+0000","last_clean":"2024-04-25T09:31:01.404324+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:31:01.404324+0000","last_undegraded":"2024-04-25T09:31:01.404324+0000","last_fullsized":"2024-04-25T09:31:01.404324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5070848,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":619,"num_write_kb":4952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.388267+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:30:47.388267+0000","last_peered":"2024-04-25T09:30:47.388267+0000","last_clean":"2024-04-25T09:30:47.388267+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:30:47.388267+0000","last_undegraded":"2024-04-25T09:30:47.388267+0000","last_fullsized":"2024-04-25T09:30:47.388267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'798","reported_seq":821,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.390346+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:31:01.390346+0000","last_peered":"2024-04-25T09:31:01.390346+0000","last_clean":"2024-04-25T09:31:01.390346+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:31:01.390346+0000","last_undegraded":"2024-04-25T09:31:01.390346+0000","last_fullsized":"2024-04-25T09:31:01.390346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6545408,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.464407+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:30:47.464407+0000","last_peered":"2024-04-25T09:30:47.464407+0000","last_clean":"2024-04-25T09:30:47.464407+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:30:47.464407+0000","last_undegraded":"2024-04-25T09:30:47.464407+0000","last_fullsized":"2024-04-25T09:30:47.464407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"31'623","reported_seq":646,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:01.323136+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:31:01.323136+0000","last_peered":"2024-04-25T09:31:01.323136+0000","last_clean":"2024-04-25T09:31:01.323136+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:31:01.323136+0000","last_undegraded":"2024-04-25T09:31:01.323136+0000","last_fullsized":"2024-04-25T09:31:01.323136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.476718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:30:47.476718+0000","last_peered":"2024-04-25T09:30:47.476718+0000","last_clean":"2024-04-25T09:30:47.476718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:30:47.476718+0000","last_undegraded":"2024-04-25T09:30:47.476718+0000","last_fullsized":"2024-04-25T09:30:47.476718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":90423296,"num_objects":1381,"num_object_clones":0,"num_object_copies":4143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11038,"num_write_kb":88304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":135823360,"data_stored":271646720,"data_compressed":14023349,"data_compressed_allocated":135823360,"data_compressed_original":271646720,"omap_allocated":0,"internal_metadata":0},"log_size":11022,"ondisk_log_size":11022,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84816,"kb_used_data":35784,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94287024,"statfs":{"total":96636764160,"available":96549912576,"internally_reserved":0,"allocated":36642816,"data_stored":73315490,"data_compressed":3779834,"data_compressed_allocated":36360192,"data_compressed_original":73211904,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77308,"kb_used_data":28276,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294532,"statfs":{"total":96636764160,"available":96557600768,"internally_reserved":0,"allocated":28954624,"data_stored":57939106,"data_compressed":2986013,"data_compressed_allocated":28672000,"data_compressed_original":57835520,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97136,"kb_used_data":35624,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94274704,"statfs":{"total":96636764160,"available":96537296896,"internally_reserved":0,"allocated":36478976,"data_stored":72520322,"data_compressed":3739312,"data_compressed_allocated":36216832,"data_compressed_original":72433664,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85952,"kb_used_data":32760,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94285888,"statfs":{"total":96636764160,"available":96548749312,"internally_reserved":0,"allocated":33546240,"data_stored":67122338,"data_compressed":3460042,"data_compressed_allocated":33263616,"data_compressed_original":67018752,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33574912,"data_stored":67149824,"data_compressed":3466453,"data_compressed_allocated":33574912,"data_compressed_original":67149824,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36556800,"data_stored":73113600,"data_compressed":3774421,"data_compressed_allocated":36556800,"data_compressed_original":73113600,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28909568,"data_stored":57819136,"data_compressed":2984810,"data_compressed_allocated":28909568,"data_compressed_original":57819136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36782080,"data_stored":73564160,"data_compressed":3797665,"data_compressed_allocated":36782080,"data_compressed_original":73564160,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:05.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 11548 11532 1.16994 0.9375 0.0780814 0.106748 2024-04-25T09:31:05.407 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:05.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:05.557+0000 7fb2e686d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:05.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:05.565+0000 7fb2e686d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:06.390 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 11686 11670 1.16877 1.07812 0.180926 0.106841 2024-04-25T09:31:07.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 11824 11808 1.16762 1.07812 0.170332 0.106946 2024-04-25T09:31:07.739 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:07.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:07.892+0000 7f8b5675d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:07.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:07.899+0000 7f8b5675d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:08.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:31:08.407267+0000 min lat: 0.0143996 max lat: 0.390003 avg lat: 0.107064 2024-04-25T09:31:08.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:31:08.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 16 11956 11940 1.16591 1.03125 0.229654 0.107064 2024-04-25T09:31:09.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 12096 12080 1.16502 1.09375 0.113848 0.107209 2024-04-25T09:31:10.033 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:10.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.191+0000 7fa4ae024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.199+0000 7fa4ae024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.192 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:10.192 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:10.192 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:31:10.193 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:31:10.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.322+0000 7f4e54a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.333+0000 7f4e54a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:10.341 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:10.342 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:10.342 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:10.342 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:10.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:10.344 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:10.345 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:31:10.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 12218 12202 1.16243 0.953125 0.218036 0.107351 2024-04-25T09:31:10.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.478+0000 7fc3fce6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.473 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.489+0000 7fc3fce6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.519 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:10.519 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:10.519 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:10.519 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:10.519 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:10.519 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:10.519 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:10.520 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:10.520 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:10.520 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:10.520 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:10.520 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:10.522 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:10.523 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:10.523 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:31:10.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.723+0000 7f3e4c8ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.734+0000 7f3e4c8ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.740 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:10.740 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:10.740 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:10.740 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:10.740 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:10.740 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:10.740 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:10.741 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:10.741 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:10.741 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:10.741 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:10.741 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:10.744 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:10.744 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:10.745 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:31:10.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.903+0000 7fceafc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:10.917+0000 7fceafc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:10.921 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:10.921 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:10.921 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:10.921 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:10.921 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:10.921 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:10.922 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:10.922 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:10.922 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:10.922 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:10.922 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:10.922 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:10.925 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:10.926 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:11.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 16 12356 12340 1.16142 1.07812 0.224009 0.107547 2024-04-25T09:31:12.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:12.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 12498 12482 1.1608 1.10938 0.177413 0.107558 2024-04-25T09:31:12.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:12.507+0000 7f2f11b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:12.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:12.513+0000 7f2f11b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:13.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 15 12618 12603 1.15826 0.945312 0.121987 0.107833 2024-04-25T09:31:14.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 12755 12739 1.15715 1.0625 0.0518898 0.107915 2024-04-25T09:31:14.788 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:14.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:14.940+0000 7f0c370ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:14.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:14.950+0000 7f0c370ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:15.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 12891 12875 1.15606 1.0625 0.0520488 0.108035 2024-04-25T09:31:15.927 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:15.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:15.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:31:16.061 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:16.071+0000 7f25c8f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:16.065 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:16.080+0000 7f25c8f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:16.358 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:31:16.359 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:31:16.373 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-04-25T09:31:15.269243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":102015520,"num_objects":1552,"num_object_clones":0,"num_object_copies":4656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":12518,"num_write_kb":100942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12462,"ondisk_log_size":12462,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":361612,"kb_used_data":148844,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377125748,"statfs":{"total":386547056640,"available":386176765952,"internally_reserved":0,"allocated":152416256,"data_stored":304484456,"data_compressed":15699498,"data_compressed_allocated":151306240,"data_compressed_original":304087040,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11001856,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":10744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002599"},"pg_stats":[{"pgid":"4.f","version":"31'855","reported_seq":876,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:12.251550+0000","last_change":"2024-04-25T09:29:47.469797+0000","last_active":"2024-04-25T09:31:12.251550+0000","last_peered":"2024-04-25T09:31:12.251550+0000","last_clean":"2024-04-25T09:31:12.251550+0000","last_became_active":"2024-04-25T09:29:47.464933+0000","last_became_peered":"2024-04-25T09:29:47.464933+0000","last_unstale":"2024-04-25T09:31:12.251550+0000","last_undegraded":"2024-04-25T09:31:12.251550+0000","last_fullsized":"2024-04-25T09:31:12.251550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"31'839","reported_seq":860,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.956588+0000","last_change":"2024-04-25T09:29:47.518293+0000","last_active":"2024-04-25T09:31:11.956588+0000","last_peered":"2024-04-25T09:31:11.956588+0000","last_clean":"2024-04-25T09:31:11.956588+0000","last_became_active":"2024-04-25T09:29:47.513402+0000","last_became_peered":"2024-04-25T09:29:47.513402+0000","last_unstale":"2024-04-25T09:31:11.956588+0000","last_undegraded":"2024-04-25T09:31:11.956588+0000","last_fullsized":"2024-04-25T09:31:11.956588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'932","reported_seq":955,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.391342+0000","last_change":"2024-04-25T09:29:47.535431+0000","last_active":"2024-04-25T09:31:11.391342+0000","last_peered":"2024-04-25T09:31:11.391342+0000","last_clean":"2024-04-25T09:31:11.391342+0000","last_became_active":"2024-04-25T09:29:47.522000+0000","last_became_peered":"2024-04-25T09:29:47.522000+0000","last_unstale":"2024-04-25T09:31:11.391342+0000","last_undegraded":"2024-04-25T09:31:11.391342+0000","last_fullsized":"2024-04-25T09:31:11.391342+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":932,"log_dups_size":0,"ondisk_log_size":932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7643136,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":7464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"31'719","reported_seq":742,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.377966+0000","last_change":"2024-04-25T09:29:47.494321+0000","last_active":"2024-04-25T09:31:11.377966+0000","last_peered":"2024-04-25T09:31:11.377966+0000","last_clean":"2024-04-25T09:31:11.377966+0000","last_became_active":"2024-04-25T09:29:47.488788+0000","last_became_peered":"2024-04-25T09:29:47.488788+0000","last_unstale":"2024-04-25T09:31:11.377966+0000","last_undegraded":"2024-04-25T09:31:11.377966+0000","last_fullsized":"2024-04-25T09:31:11.377966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"31'727","reported_seq":750,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:10.930655+0000","last_change":"2024-04-25T09:29:47.502228+0000","last_active":"2024-04-25T09:31:10.930655+0000","last_peered":"2024-04-25T09:31:10.930655+0000","last_clean":"2024-04-25T09:31:10.930655+0000","last_became_active":"2024-04-25T09:29:47.495421+0000","last_became_peered":"2024-04-25T09:29:47.495421+0000","last_unstale":"2024-04-25T09:31:10.930655+0000","last_undegraded":"2024-04-25T09:31:10.930655+0000","last_fullsized":"2024-04-25T09:31:10.930655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"31'791","reported_seq":814,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:09.822433+0000","last_change":"2024-04-25T09:29:47.585519+0000","last_active":"2024-04-25T09:31:09.822433+0000","last_peered":"2024-04-25T09:31:09.822433+0000","last_clean":"2024-04-25T09:31:09.822433+0000","last_became_active":"2024-04-25T09:29:47.577273+0000","last_became_peered":"2024-04-25T09:29:47.577273+0000","last_unstale":"2024-04-25T09:31:09.822433+0000","last_undegraded":"2024-04-25T09:31:09.822433+0000","last_fullsized":"2024-04-25T09:31:09.822433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"31'751","reported_seq":774,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:09.514409+0000","last_change":"2024-04-25T09:29:47.484218+0000","last_active":"2024-04-25T09:31:09.514409+0000","last_peered":"2024-04-25T09:31:09.514409+0000","last_clean":"2024-04-25T09:31:09.514409+0000","last_became_active":"2024-04-25T09:29:47.478871+0000","last_became_peered":"2024-04-25T09:29:47.478871+0000","last_unstale":"2024-04-25T09:31:09.514409+0000","last_undegraded":"2024-04-25T09:31:09.514409+0000","last_fullsized":"2024-04-25T09:31:09.514409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"31'657","reported_seq":680,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.395827+0000","last_change":"2024-04-25T09:29:47.528916+0000","last_active":"2024-04-25T09:31:11.395827+0000","last_peered":"2024-04-25T09:31:11.395827+0000","last_clean":"2024-04-25T09:31:11.395827+0000","last_became_active":"2024-04-25T09:29:47.520188+0000","last_became_peered":"2024-04-25T09:29:47.520188+0000","last_unstale":"2024-04-25T09:31:11.395827+0000","last_undegraded":"2024-04-25T09:31:11.395827+0000","last_fullsized":"2024-04-25T09:31:11.395827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5390336,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":658,"num_write_kb":5264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"31'735","reported_seq":758,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.009347+0000","last_change":"2024-04-25T09:29:47.502088+0000","last_active":"2024-04-25T09:31:11.009347+0000","last_peered":"2024-04-25T09:31:11.009347+0000","last_clean":"2024-04-25T09:31:11.009347+0000","last_became_active":"2024-04-25T09:29:47.496111+0000","last_became_peered":"2024-04-25T09:29:47.496111+0000","last_unstale":"2024-04-25T09:31:11.009347+0000","last_undegraded":"2024-04-25T09:31:11.009347+0000","last_fullsized":"2024-04-25T09:31:11.009347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":189,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.382117+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:30:47.382117+0000","last_peered":"2024-04-25T09:30:47.382117+0000","last_clean":"2024-04-25T09:30:47.382117+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:30:47.382117+0000","last_undegraded":"2024-04-25T09:30:47.382117+0000","last_fullsized":"2024-04-25T09:30:47.382117+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.459456+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:30:47.459456+0000","last_peered":"2024-04-25T09:30:47.459456+0000","last_clean":"2024-04-25T09:30:47.459456+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:30:47.459456+0000","last_undegraded":"2024-04-25T09:30:47.459456+0000","last_fullsized":"2024-04-25T09:30:47.459456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"31'771","reported_seq":794,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.393691+0000","last_change":"2024-04-25T09:29:47.532361+0000","last_active":"2024-04-25T09:31:11.393691+0000","last_peered":"2024-04-25T09:31:11.393691+0000","last_clean":"2024-04-25T09:31:11.393691+0000","last_became_active":"2024-04-25T09:29:47.511553+0000","last_became_peered":"2024-04-25T09:29:47.511553+0000","last_unstale":"2024-04-25T09:31:11.393691+0000","last_undegraded":"2024-04-25T09:31:11.393691+0000","last_fullsized":"2024-04-25T09:31:11.393691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324224,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":6176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.455737+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:30:47.455737+0000","last_peered":"2024-04-25T09:30:47.455737+0000","last_clean":"2024-04-25T09:30:47.455737+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:30:47.455737+0000","last_undegraded":"2024-04-25T09:30:47.455737+0000","last_fullsized":"2024-04-25T09:30:47.455737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"31'735","reported_seq":756,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:10.848430+0000","last_change":"2024-04-25T09:29:47.454096+0000","last_active":"2024-04-25T09:31:10.848430+0000","last_peered":"2024-04-25T09:31:10.848430+0000","last_clean":"2024-04-25T09:31:10.848430+0000","last_became_active":"2024-04-25T09:29:47.447281+0000","last_became_peered":"2024-04-25T09:29:47.447281+0000","last_unstale":"2024-04-25T09:31:10.848430+0000","last_undegraded":"2024-04-25T09:31:10.848430+0000","last_fullsized":"2024-04-25T09:31:10.848430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.447740+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:30:47.447740+0000","last_peered":"2024-04-25T09:30:47.447740+0000","last_clean":"2024-04-25T09:30:47.447740+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:30:47.447740+0000","last_undegraded":"2024-04-25T09:30:47.447740+0000","last_fullsized":"2024-04-25T09:30:47.447740+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"31'745","reported_seq":766,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:12.394457+0000","last_change":"2024-04-25T09:29:47.435237+0000","last_active":"2024-04-25T09:31:12.394457+0000","last_peered":"2024-04-25T09:31:12.394457+0000","last_clean":"2024-04-25T09:31:12.394457+0000","last_became_active":"2024-04-25T09:29:47.423125+0000","last_became_peered":"2024-04-25T09:29:47.423125+0000","last_unstale":"2024-04-25T09:31:12.394457+0000","last_undegraded":"2024-04-25T09:31:12.394457+0000","last_fullsized":"2024-04-25T09:31:12.394457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6111232,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":5968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.452503+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:30:47.452503+0000","last_peered":"2024-04-25T09:30:47.452503+0000","last_clean":"2024-04-25T09:30:47.452503+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:30:47.452503+0000","last_undegraded":"2024-04-25T09:30:47.452503+0000","last_fullsized":"2024-04-25T09:30:47.452503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"31'807","reported_seq":830,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.320205+0000","last_change":"2024-04-25T09:29:47.434709+0000","last_active":"2024-04-25T09:31:11.320205+0000","last_peered":"2024-04-25T09:31:11.320205+0000","last_clean":"2024-04-25T09:31:11.320205+0000","last_became_active":"2024-04-25T09:29:47.430196+0000","last_became_peered":"2024-04-25T09:29:47.430196+0000","last_unstale":"2024-04-25T09:31:11.320205+0000","last_undegraded":"2024-04-25T09:31:11.320205+0000","last_fullsized":"2024-04-25T09:31:11.320205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.448068+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:30:47.448068+0000","last_peered":"2024-04-25T09:30:47.448068+0000","last_clean":"2024-04-25T09:30:47.448068+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:30:47.448068+0000","last_undegraded":"2024-04-25T09:30:47.448068+0000","last_fullsized":"2024-04-25T09:30:47.448068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"31'695","reported_seq":718,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.006742+0000","last_change":"2024-04-25T09:29:47.477499+0000","last_active":"2024-04-25T09:31:11.006742+0000","last_peered":"2024-04-25T09:31:11.006742+0000","last_clean":"2024-04-25T09:31:11.006742+0000","last_became_active":"2024-04-25T09:29:47.467763+0000","last_became_peered":"2024-04-25T09:29:47.467763+0000","last_unstale":"2024-04-25T09:31:11.006742+0000","last_undegraded":"2024-04-25T09:31:11.006742+0000","last_fullsized":"2024-04-25T09:31:11.006742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.388267+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:30:47.388267+0000","last_peered":"2024-04-25T09:30:47.388267+0000","last_clean":"2024-04-25T09:30:47.388267+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:30:47.388267+0000","last_undegraded":"2024-04-25T09:30:47.388267+0000","last_fullsized":"2024-04-25T09:30:47.388267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'879","reported_seq":902,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:11.245532+0000","last_change":"2024-04-25T09:29:47.554506+0000","last_active":"2024-04-25T09:31:11.245532+0000","last_peered":"2024-04-25T09:31:11.245532+0000","last_clean":"2024-04-25T09:31:11.245532+0000","last_became_active":"2024-04-25T09:29:47.549264+0000","last_became_peered":"2024-04-25T09:29:47.549264+0000","last_unstale":"2024-04-25T09:31:11.245532+0000","last_undegraded":"2024-04-25T09:31:11.245532+0000","last_fullsized":"2024-04-25T09:31:11.245532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.464407+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:30:47.464407+0000","last_peered":"2024-04-25T09:30:47.464407+0000","last_clean":"2024-04-25T09:30:47.464407+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:30:47.464407+0000","last_undegraded":"2024-04-25T09:30:47.464407+0000","last_fullsized":"2024-04-25T09:30:47.464407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"31'727","reported_seq":750,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:31:10.167674+0000","last_change":"2024-04-25T09:29:47.539073+0000","last_active":"2024-04-25T09:31:10.167674+0000","last_peered":"2024-04-25T09:31:10.167674+0000","last_clean":"2024-04-25T09:31:10.167674+0000","last_became_active":"2024-04-25T09:29:47.529783+0000","last_became_peered":"2024-04-25T09:29:47.529783+0000","last_unstale":"2024-04-25T09:31:10.167674+0000","last_undegraded":"2024-04-25T09:31:10.167674+0000","last_fullsized":"2024-04-25T09:31:10.167674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:29:46.306188+0000","last_clean_scrub_stamp":"2024-04-25T09:29:46.306188+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-25T09:30:47.476718+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:30:47.476718+0000","last_peered":"2024-04-25T09:30:47.476718+0000","last_clean":"2024-04-25T09:30:47.476718+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:30:47.476718+0000","last_undegraded":"2024-04-25T09:30:47.476718+0000","last_fullsized":"2024-04-25T09:30:47.476718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":101425152,"num_objects":1550,"num_object_clones":0,"num_object_copies":4650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12381,"num_write_kb":99048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":152555520,"data_stored":305111040,"data_compressed":15751302,"data_compressed_allocated":152555520,"data_compressed_original":305111040,"omap_allocated":0,"internal_metadata":0},"log_size":12365,"ondisk_log_size":12365,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93576,"kb_used_data":40384,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94278264,"statfs":{"total":96636764160,"available":96540942336,"internally_reserved":0,"allocated":41353216,"data_stored":82736290,"data_compressed":4266283,"data_compressed_allocated":41070592,"data_compressed_original":82632704,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85064,"kb_used_data":31872,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94286776,"statfs":{"total":96636764160,"available":96549658624,"internally_reserved":0,"allocated":32636928,"data_stored":65303714,"data_compressed":3366290,"data_compressed_allocated":32354304,"data_compressed_original":65200128,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88960,"kb_used_data":39928,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94282880,"statfs":{"total":96636764160,"available":96545669120,"internally_reserved":0,"allocated":40886272,"data_stored":81334914,"data_compressed":4194459,"data_compressed_allocated":40624128,"data_compressed_original":81248256,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94012,"kb_used_data":36660,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94277828,"statfs":{"total":96636764160,"available":96540495872,"internally_reserved":0,"allocated":37539840,"data_stored":75109538,"data_compressed":3872466,"data_compressed_allocated":37257216,"data_compressed_original":75005952,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":37597184,"data_stored":75194368,"data_compressed":3881838,"data_compressed_allocated":37597184,"data_compressed_original":75194368,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40955904,"data_stored":81911808,"data_compressed":4228722,"data_compressed_allocated":40955904,"data_compressed_original":81911808,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32600064,"data_stored":65200128,"data_compressed":3365933,"data_compressed_allocated":32600064,"data_compressed_original":65200128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41402368,"data_stored":82804736,"data_compressed":4274809,"data_compressed_allocated":41402368,"data_compressed_original":82804736,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:16.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 13005 12989 1.15304 0.890625 0.0342031 0.108315 2024-04-25T09:31:17.159 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:17.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:17.291+0000 7f81d3024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:17.283 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:17.298+0000 7f81d3024640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:17.391 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 13147 13131 1.15255 1.10938 0.13854 0.108376 2024-04-25T09:31:18.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 15 13285 13270 1.15181 1.08594 0.0757207 0.108442 2024-04-25T09:31:19.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1204 2024-04-25T09:31:19.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 13285 2024-04-25T09:31:19.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:31:19.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:31:19.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.15167 2024-04-25T09:31:19.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.111874 2024-04-25T09:31:19.392 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.42188 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.890625 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 147 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 14.3199 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 182 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 114 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.108462 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.0567249 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.390003 2024-04-25T09:31:19.393 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0143996 2024-04-25T09:31:19.419 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:31:19.520 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:19.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:19.682+0000 7f660dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:19.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:19.693+0000 7f660dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:21.375 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:21.376 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:21.376 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:31:21.376 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:31:21.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:21.553+0000 7fe8d4206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:21.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:21.566+0000 7fe8d4206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:21.722 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:21.722 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:21.722 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:21.722 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:21.723 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:21.726 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:21.726 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:21.726 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:31:21.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:21.881+0000 7f25b56ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:21.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:21.895+0000 7f25b56ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:21.902 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:21.903 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:21.903 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:21.904 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:21.905 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:21.905 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:31:22.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:22.064+0000 7fee7dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:22.061 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:22.076+0000 7fee7dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:22.104 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:22.112 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:22.113 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:22.113 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:22.113 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:22.113 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:22.119 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:22.119 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:22.119 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:31:22.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:22.289+0000 7f546e5ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:22.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:22.297+0000 7f546e5ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:22.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:22.317+0000 7f285359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:22.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:22.330+0000 7f285359d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:22.366 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:22.366 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:22.366 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:22.366 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:22.366 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:22.367 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:22.367 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:22.367 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:22.367 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:22.367 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:22.367 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:22.367 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:22.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:22.370 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:24.755 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:24.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:24.935+0000 7fbb65f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:24.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:24.944+0000 7fbb65f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:27.346 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:27.371 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:27.371 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:27.371 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:31:27.371 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:31:27.511 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:27.524+0000 7f7165cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:27.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:27.534+0000 7f7165cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:27.554 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:27.563+0000 7f227266d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:27.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:27.577+0000 7f227266d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:27.719 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:27.719 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:27.720 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:27.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:27.723 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:27.723 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:31:27.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:27.886+0000 7f8ac9c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:27.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:27.902+0000 7f8ac9c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:28.027 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:28.027 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:28.027 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:28.027 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:28.027 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:28.028 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:28.028 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:28.028 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:28.028 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:28.028 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:28.028 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:28.028 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:28.030 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:28.030 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:28.031 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:31:28.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:28.190+0000 7f4f70b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:28.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:28.204+0000 7f4f70b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:28.216 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:28.216 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:28.216 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:28.216 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:28.216 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:28.216 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:28.217 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:28.217 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:28.217 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:28.217 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:28.217 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:28.217 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:28.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:28.222 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:28.222 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:31:28.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:28.371+0000 7f70d7824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:28.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:28.384+0000 7f70d7824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:28.394 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:28.394 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:28.394 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:28.394 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:28.394 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:28.394 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:28.394 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:28.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:28.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:28.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:28.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:28.395 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:28.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:28.398 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:28.653 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1661 objects 2024-04-25T09:31:28.654 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :9.23421 2024-04-25T09:31:30.082 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:30.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:30.214+0000 7fb8f346d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:30.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:30.219+0000 7fb8f346d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:32.048 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-04-25T09:31:32.048 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-04-25T09:31:32.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:32.168+0000 7fa7a1d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:32.165 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:32.181+0000 7fa7a1d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:32.305 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:32.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:32.424+0000 7fee7182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:32.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:32.429+0000 7fee7182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.322 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_1' removed 2024-04-25T09:31:33.344 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:31:33.345 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:31:33.345 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-04-25T09:31:33.345 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-04-25T09:31:33.399 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:33.399 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:33.399 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:31:33.399 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:31:33.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.492+0000 7f2a23257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.512+0000 7f2a23257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.537+0000 7fd49b954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.546+0000 7fd49b954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:33.546 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:33.547 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:33.547 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:33.547 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:33.547 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:33.549 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:33.550 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:33.550 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:31:33.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.670+0000 7f24bcf5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.679+0000 7f24bcf5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:33.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:33.683 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:33.683 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:31:33.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.803+0000 7fc6d1b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.812+0000 7fc6d1b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:33.813 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:33.815 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:33.816 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:33.816 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:31:33.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.934+0000 7f1bf4aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:33.943+0000 7f1bf4aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:33.946 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:33.946 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:33.946 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:33.946 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:33.947 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:33.948 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:34.322 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_2' created 2024-04-25T09:31:34.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-04-25T09:31:34.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:34.482+0000 7f1994754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:34.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:34.505+0000 7f1994754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:34.513 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:34.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:34.647+0000 7f538946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:34.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:34.654+0000 7f538946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:35.330 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-04-25T09:31:36.355 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-04-25T09:31:36.358 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:31:36.358 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:31:36.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:31:36.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:31:36.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_38456 2024-04-25T09:31:36.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:31:36.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:31:36.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:36.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:36.907+0000 7fb3cfc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:36.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:36.913+0000 7fb3cfc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:37.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 171 155 1.21087 1.21094 0.0874068 0.0983474 2024-04-25T09:31:38.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 337 321 1.25383 1.29688 0.0715076 0.0964196 2024-04-25T09:31:38.948 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:38.949 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:38.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:31:39.089 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:39.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:39.097+0000 7f92a1a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:39.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:39.111+0000 7f92a1a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:39.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:39.232+0000 7f9b51b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:39.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:39.239+0000 7f9b51b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:39.349 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:31:39.349 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:31:39.367 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-04-25T09:31:39.274663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1204768,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":212,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":168,"ondisk_log_size":168,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":218480,"kb_used_data":1552,"kb_used_omap":0,"kb_used_meta":216896,"kb_avail":377268880,"statfs":{"total":386547056640,"available":386323333120,"internally_reserved":0,"allocated":1589248,"data_stored":2617122,"data_compressed":113038,"data_compressed_allocated":348160,"data_compressed_original":2170880,"omap_allocated":0,"internal_metadata":222101504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":614400,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.936542"},"pg_stats":[{"pgid":"5.f","version":"35'19","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:37.411608+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:31:37.411608+0000","last_peered":"2024-04-25T09:31:37.411608+0000","last_clean":"2024-04-25T09:31:37.411608+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:31:37.411608+0000","last_undegraded":"2024-04-25T09:31:37.411608+0000","last_fullsized":"2024-04-25T09:31:37.411608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163840,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.552811+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:31:35.552811+0000","last_peered":"2024-04-25T09:31:35.552811+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:31:35.552811+0000","last_undegraded":"2024-04-25T09:31:35.552811+0000","last_fullsized":"2024-04-25T09:31:35.552811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.533057+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:31:35.533057+0000","last_peered":"2024-04-25T09:31:35.533057+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:31:35.533057+0000","last_undegraded":"2024-04-25T09:31:35.533057+0000","last_fullsized":"2024-04-25T09:31:35.533057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"35'23","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:37.360381+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:31:37.360381+0000","last_peered":"2024-04-25T09:31:37.360381+0000","last_clean":"2024-04-25T09:31:37.360381+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:31:37.360381+0000","last_undegraded":"2024-04-25T09:31:37.360381+0000","last_fullsized":"2024-04-25T09:31:37.360381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.582568+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:31:35.582568+0000","last_peered":"2024-04-25T09:31:35.582568+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:31:35.582568+0000","last_undegraded":"2024-04-25T09:31:35.582568+0000","last_fullsized":"2024-04-25T09:31:35.582568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.378259+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:31:36.378259+0000","last_peered":"2024-04-25T09:31:36.378259+0000","last_clean":"2024-04-25T09:31:36.378259+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:31:36.378259+0000","last_undegraded":"2024-04-25T09:31:36.378259+0000","last_fullsized":"2024-04-25T09:31:36.378259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.510746+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:31:35.510746+0000","last_peered":"2024-04-25T09:31:35.510746+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:31:35.510746+0000","last_undegraded":"2024-04-25T09:31:35.510746+0000","last_fullsized":"2024-04-25T09:31:35.510746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.557899+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:31:35.557899+0000","last_peered":"2024-04-25T09:31:35.557899+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:31:35.557899+0000","last_undegraded":"2024-04-25T09:31:35.557899+0000","last_fullsized":"2024-04-25T09:31:35.557899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.377266+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:31:36.377266+0000","last_peered":"2024-04-25T09:31:36.377266+0000","last_clean":"2024-04-25T09:31:36.377266+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:31:36.377266+0000","last_undegraded":"2024-04-25T09:31:36.377266+0000","last_fullsized":"2024-04-25T09:31:36.377266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":199,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.503573+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:31:36.503573+0000","last_peered":"2024-04-25T09:31:36.503573+0000","last_clean":"2024-04-25T09:31:36.503573+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:31:36.503573+0000","last_undegraded":"2024-04-25T09:31:36.503573+0000","last_fullsized":"2024-04-25T09:31:36.503573+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.383463+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:31:35.383463+0000","last_peered":"2024-04-25T09:31:35.383463+0000","last_clean":"2024-04-25T09:31:35.383463+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:31:35.383463+0000","last_undegraded":"2024-04-25T09:31:35.383463+0000","last_fullsized":"2024-04-25T09:31:35.383463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.539819+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:31:35.539819+0000","last_peered":"2024-04-25T09:31:35.539819+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:31:35.539819+0000","last_undegraded":"2024-04-25T09:31:35.539819+0000","last_fullsized":"2024-04-25T09:31:35.539819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.386069+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:31:35.386069+0000","last_peered":"2024-04-25T09:31:35.386069+0000","last_clean":"2024-04-25T09:31:35.386069+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:31:35.386069+0000","last_undegraded":"2024-04-25T09:31:35.386069+0000","last_fullsized":"2024-04-25T09:31:35.386069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.375792+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:31:36.375792+0000","last_peered":"2024-04-25T09:31:36.375792+0000","last_clean":"2024-04-25T09:31:36.375792+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:31:36.375792+0000","last_undegraded":"2024-04-25T09:31:36.375792+0000","last_fullsized":"2024-04-25T09:31:36.375792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.363084+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:31:35.363084+0000","last_peered":"2024-04-25T09:31:35.363084+0000","last_clean":"2024-04-25T09:31:35.363084+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:31:35.363084+0000","last_undegraded":"2024-04-25T09:31:35.363084+0000","last_fullsized":"2024-04-25T09:31:35.363084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"35'23","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:37.392978+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:31:37.392978+0000","last_peered":"2024-04-25T09:31:37.392978+0000","last_clean":"2024-04-25T09:31:37.392978+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:31:37.392978+0000","last_undegraded":"2024-04-25T09:31:37.392978+0000","last_fullsized":"2024-04-25T09:31:37.392978+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.394295+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:31:35.394295+0000","last_peered":"2024-04-25T09:31:35.394295+0000","last_clean":"2024-04-25T09:31:35.394295+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:31:35.394295+0000","last_undegraded":"2024-04-25T09:31:35.394295+0000","last_fullsized":"2024-04-25T09:31:35.394295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"35'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:37.405555+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:31:37.405555+0000","last_peered":"2024-04-25T09:31:37.405555+0000","last_clean":"2024-04-25T09:31:37.405555+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:31:37.405555+0000","last_undegraded":"2024-04-25T09:31:37.405555+0000","last_fullsized":"2024-04-25T09:31:37.405555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.386702+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:31:36.386702+0000","last_peered":"2024-04-25T09:31:36.386702+0000","last_clean":"2024-04-25T09:31:36.386702+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:31:36.386702+0000","last_undegraded":"2024-04-25T09:31:36.386702+0000","last_fullsized":"2024-04-25T09:31:36.386702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.527906+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:31:35.527906+0000","last_peered":"2024-04-25T09:31:35.527906+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:31:35.527906+0000","last_undegraded":"2024-04-25T09:31:35.527906+0000","last_fullsized":"2024-04-25T09:31:35.527906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.511681+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:31:36.511681+0000","last_peered":"2024-04-25T09:31:36.511681+0000","last_clean":"2024-04-25T09:31:36.511681+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:31:36.511681+0000","last_undegraded":"2024-04-25T09:31:36.511681+0000","last_fullsized":"2024-04-25T09:31:36.511681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.518853+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:31:36.518853+0000","last_peered":"2024-04-25T09:31:36.518853+0000","last_clean":"2024-04-25T09:31:36.518853+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:31:36.518853+0000","last_undegraded":"2024-04-25T09:31:36.518853+0000","last_fullsized":"2024-04-25T09:31:36.518853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.379673+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:31:36.379673+0000","last_peered":"2024-04-25T09:31:36.379673+0000","last_clean":"2024-04-25T09:31:36.379673+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:31:36.379673+0000","last_undegraded":"2024-04-25T09:31:36.379673+0000","last_fullsized":"2024-04-25T09:31:36.379673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.616572+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:31:35.616572+0000","last_peered":"2024-04-25T09:31:35.616572+0000","last_clean":"2024-04-25T09:31:34.337447+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:31:35.616572+0000","last_undegraded":"2024-04-25T09:31:35.616572+0000","last_fullsized":"2024-04-25T09:31:35.616572+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T09:31:35.377719+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:31:35.377719+0000","last_peered":"2024-04-25T09:31:35.377719+0000","last_clean":"2024-04-25T09:31:35.377719+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:31:35.377719+0000","last_undegraded":"2024-04-25T09:31:35.377719+0000","last_fullsized":"2024-04-25T09:31:35.377719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":614400,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1060864,"data_stored":2121728,"data_compressed":109120,"data_compressed_allocated":1060864,"data_compressed_original":2121728,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49512,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":491520,"data_stored":953165,"data_compressed":43431,"data_compressed_allocated":172032,"data_compressed_original":835584,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61956,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94309884,"statfs":{"total":96636764160,"available":96573321216,"internally_reserved":0,"allocated":454656,"data_stored":879437,"data_compressed":39640,"data_compressed_allocated":135168,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57636,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94314204,"statfs":{"total":96636764160,"available":96577744896,"internally_reserved":0,"allocated":290816,"data_stored":97076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49376,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94322464,"statfs":{"total":96636764160,"available":96586203136,"internally_reserved":0,"allocated":352256,"data_stored":687444,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":1097728,"data_compressed":56454,"data_compressed_allocated":548864,"data_compressed_original":1097728,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":1024000,"data_compressed":52666,"data_compressed_allocated":512000,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:39.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 495 479 1.24731 1.23438 0.0420319 0.0970433 2024-04-25T09:31:40.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 655 639 1.24796 1.25 0.0574413 0.0984466 2024-04-25T09:31:41.405 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:41.421 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 808 792 1.23741 1.19531 0.042877 0.0995904 2024-04-25T09:31:41.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:41.553+0000 7f7b576ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:41.545 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:41.560+0000 7f7b576ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:42.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 970 954 1.24209 1.26562 0.116706 0.0994362 2024-04-25T09:31:43.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 1118 1102 1.22981 1.15625 0.0269468 0.100839 2024-04-25T09:31:43.763 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:43.896 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:43.908+0000 7fb8deb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:43.901 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:43.916+0000 7fb8deb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:44.369 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:44.369 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:44.370 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:31:44.370 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:31:44.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1285 1269 1.23916 1.30469 0.179962 0.100096 2024-04-25T09:31:44.501 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:44.509+0000 7f5068ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:44.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:44.521+0000 7f5068ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:44.552 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:44.552 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:44.552 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:44.552 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:44.552 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:44.552 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:44.552 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:44.553 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:44.553 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:44.553 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:44.553 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:44.554 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:44.555 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:44.556 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:44.556 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:31:44.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:44.712+0000 7ff676b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:44.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:44.723+0000 7ff676b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:44.730 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:44.730 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:44.730 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:44.730 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:44.731 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:44.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:44.734 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:44.734 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:31:44.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:44.900+0000 7f43f800f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:44.963 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:44.911+0000 7f43f800f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:44.964 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:44.965 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:44.965 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:44.965 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:44.965 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:44.965 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:44.965 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:31:45.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:45.115+0000 7f6df61ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:45.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:45.125+0000 7f6df61ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:31:45.128 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:31:45.131 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:31:45.131 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:31:45.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1447 1431 1.24209 1.26562 0.0613892 0.100052 2024-04-25T09:31:46.170 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:46.308 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:46.321+0000 7f4e0e62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:46.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:46.327+0000 7f4e0e62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:46.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 15 1600 1585 1.23818 1.20312 0.0438871 0.100148 2024-04-25T09:31:47.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1754 1738 1.23428 1.19531 0.0665387 0.100727 2024-04-25T09:31:48.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1905 1889 1.22971 1.17969 0.131871 0.10103 2024-04-25T09:31:48.490 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:48.620 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:48.633+0000 7f658322d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:48.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:48.641+0000 7f658322d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:49.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 2060 2044 1.22826 1.21094 0.17797 0.101328 2024-04-25T09:31:50.132 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:50.132 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:31:50.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:50.270+0000 7f607b75d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:50.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:50.284+0000 7f607b75d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:50.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 2215 2199 1.22702 1.21094 0.171731 0.101312 2024-04-25T09:31:50.686 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:31:50.701 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:31:50.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:50.836+0000 7f9a148ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:50.832 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:50.847+0000 7f9a148ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:50.888 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:51.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:51.043+0000 7f1709d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:51.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:51.050+0000 7f1709d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:51.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2372 2356 1.22698 1.22656 0.0470583 0.101508 2024-04-25T09:31:51.690 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:31:51.709 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:31:51.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:51.856+0000 7fa01f86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:51.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:51.869+0000 7fa01f86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:52.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2522 2506 1.22353 1.17188 0.0789021 0.101713 2024-04-25T09:31:52.693 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:31:52.716 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:31:52.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:52.852+0000 7f3f5ee17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:52.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:52.865+0000 7f3f5ee17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:53.243 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:53.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:53.386+0000 7fb8c535d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:53.377 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:53.393+0000 7fb8c535d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:53.422 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2680 2664 1.22416 1.23438 0.0999393 0.101701 2024-04-25T09:31:53.699 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:31:53.723 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:31:53.723 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:31:53.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:53.873+0000 7fd4c8aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:53.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:53.883+0000 7fd4c8aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:54.171 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:31:54.171 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:31:54.187 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-04-25T09:31:53.719721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20677152,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2589,"num_write_kb":21510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2535,"ondisk_log_size":2535,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237796,"kb_used_data":29188,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377249564,"statfs":{"total":386547056640,"available":386303553536,"internally_reserved":0,"allocated":29888512,"data_stored":59150619,"data_compressed":3028113,"data_compressed_allocated":28606464,"data_compressed_original":58687488,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6283264,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.442841"},"pg_stats":[{"pgid":"5.f","version":"36'204","reported_seq":220,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.397390+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:31:52.397390+0000","last_peered":"2024-04-25T09:31:52.397390+0000","last_clean":"2024-04-25T09:31:52.397390+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:31:52.397390+0000","last_undegraded":"2024-04-25T09:31:52.397390+0000","last_fullsized":"2024-04-25T09:31:52.397390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1679360,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"35'87","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:48.789710+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:31:48.789710+0000","last_peered":"2024-04-25T09:31:48.789710+0000","last_clean":"2024-04-25T09:31:48.789710+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:31:48.789710+0000","last_undegraded":"2024-04-25T09:31:48.789710+0000","last_fullsized":"2024-04-25T09:31:48.789710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"35'131","reported_seq":144,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.420144+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:31:51.420144+0000","last_peered":"2024-04-25T09:31:51.420144+0000","last_clean":"2024-04-25T09:31:51.420144+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:31:51.420144+0000","last_undegraded":"2024-04-25T09:31:51.420144+0000","last_fullsized":"2024-04-25T09:31:51.420144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"36'120","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.724398+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:31:51.724398+0000","last_peered":"2024-04-25T09:31:51.724398+0000","last_clean":"2024-04-25T09:31:51.724398+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:31:51.724398+0000","last_undegraded":"2024-04-25T09:31:51.724398+0000","last_fullsized":"2024-04-25T09:31:51.724398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'119","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:50.090256+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:31:50.090256+0000","last_peered":"2024-04-25T09:31:50.090256+0000","last_clean":"2024-04-25T09:31:50.090256+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:31:50.090256+0000","last_undegraded":"2024-04-25T09:31:50.090256+0000","last_fullsized":"2024-04-25T09:31:50.090256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"36'151","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.817117+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:31:51.817117+0000","last_peered":"2024-04-25T09:31:51.817117+0000","last_clean":"2024-04-25T09:31:51.817117+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:31:51.817117+0000","last_undegraded":"2024-04-25T09:31:51.817117+0000","last_fullsized":"2024-04-25T09:31:51.817117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"35'142","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.407197+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:31:51.407197+0000","last_peered":"2024-04-25T09:31:51.407197+0000","last_clean":"2024-04-25T09:31:51.407197+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:31:51.407197+0000","last_undegraded":"2024-04-25T09:31:51.407197+0000","last_fullsized":"2024-04-25T09:31:51.407197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1171456,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"35'127","reported_seq":140,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.197730+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:31:51.197730+0000","last_peered":"2024-04-25T09:31:51.197730+0000","last_clean":"2024-04-25T09:31:51.197730+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:31:51.197730+0000","last_undegraded":"2024-04-25T09:31:51.197730+0000","last_fullsized":"2024-04-25T09:31:51.197730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"35'152","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.562380+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:31:51.562380+0000","last_peered":"2024-04-25T09:31:51.562380+0000","last_clean":"2024-04-25T09:31:51.562380+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:31:51.562380+0000","last_undegraded":"2024-04-25T09:31:51.562380+0000","last_fullsized":"2024-04-25T09:31:51.562380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":205,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.729975+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:31:51.729975+0000","last_peered":"2024-04-25T09:31:51.729975+0000","last_clean":"2024-04-25T09:31:51.729975+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:31:51.729975+0000","last_undegraded":"2024-04-25T09:31:51.729975+0000","last_fullsized":"2024-04-25T09:31:51.729975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.815536+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:31:36.815536+0000","last_peered":"2024-04-25T09:31:36.815536+0000","last_clean":"2024-04-25T09:31:36.815536+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:31:36.815536+0000","last_undegraded":"2024-04-25T09:31:36.815536+0000","last_fullsized":"2024-04-25T09:31:36.815536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'183","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:50.591539+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:31:50.591539+0000","last_peered":"2024-04-25T09:31:50.591539+0000","last_clean":"2024-04-25T09:31:50.591539+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:31:50.591539+0000","last_undegraded":"2024-04-25T09:31:50.591539+0000","last_fullsized":"2024-04-25T09:31:50.591539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.462487+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:31:36.462487+0000","last_peered":"2024-04-25T09:31:36.462487+0000","last_clean":"2024-04-25T09:31:36.462487+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:31:36.462487+0000","last_undegraded":"2024-04-25T09:31:36.462487+0000","last_fullsized":"2024-04-25T09:31:36.462487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'161","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.415373+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:31:52.415373+0000","last_peered":"2024-04-25T09:31:52.415373+0000","last_clean":"2024-04-25T09:31:52.415373+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:31:52.415373+0000","last_undegraded":"2024-04-25T09:31:52.415373+0000","last_fullsized":"2024-04-25T09:31:52.415373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327104,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":1296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.812873+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:31:36.812873+0000","last_peered":"2024-04-25T09:31:36.812873+0000","last_clean":"2024-04-25T09:31:36.812873+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:31:36.812873+0000","last_undegraded":"2024-04-25T09:31:36.812873+0000","last_fullsized":"2024-04-25T09:31:36.812873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"36'156","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.402506+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:31:52.402506+0000","last_peered":"2024-04-25T09:31:52.402506+0000","last_clean":"2024-04-25T09:31:52.402506+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:31:52.402506+0000","last_undegraded":"2024-04-25T09:31:52.402506+0000","last_fullsized":"2024-04-25T09:31:52.402506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1286144,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.463669+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:31:36.463669+0000","last_peered":"2024-04-25T09:31:36.463669+0000","last_clean":"2024-04-25T09:31:36.463669+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:31:36.463669+0000","last_undegraded":"2024-04-25T09:31:36.463669+0000","last_fullsized":"2024-04-25T09:31:36.463669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'183","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.384055+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:31:52.384055+0000","last_peered":"2024-04-25T09:31:52.384055+0000","last_clean":"2024-04-25T09:31:52.384055+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:31:52.384055+0000","last_undegraded":"2024-04-25T09:31:52.384055+0000","last_fullsized":"2024-04-25T09:31:52.384055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.558209+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:31:51.558209+0000","last_peered":"2024-04-25T09:31:51.558209+0000","last_clean":"2024-04-25T09:31:51.558209+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:31:51.558209+0000","last_undegraded":"2024-04-25T09:31:51.558209+0000","last_fullsized":"2024-04-25T09:31:51.558209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"35'196","reported_seq":209,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.419351+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:31:51.419351+0000","last_peered":"2024-04-25T09:31:51.419351+0000","last_clean":"2024-04-25T09:31:51.419351+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:31:51.419351+0000","last_undegraded":"2024-04-25T09:31:51.419351+0000","last_fullsized":"2024-04-25T09:31:51.419351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613824,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":1576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.732019+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:31:51.732019+0000","last_peered":"2024-04-25T09:31:51.732019+0000","last_clean":"2024-04-25T09:31:51.732019+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:31:51.732019+0000","last_undegraded":"2024-04-25T09:31:51.732019+0000","last_fullsized":"2024-04-25T09:31:51.732019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"37'207","reported_seq":226,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.151999+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:31:52.151999+0000","last_peered":"2024-04-25T09:31:52.151999+0000","last_clean":"2024-04-25T09:31:52.151999+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:31:52.151999+0000","last_undegraded":"2024-04-25T09:31:52.151999+0000","last_fullsized":"2024-04-25T09:31:52.151999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.567166+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:31:51.567166+0000","last_peered":"2024-04-25T09:31:51.567166+0000","last_clean":"2024-04-25T09:31:51.567166+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:31:51.567166+0000","last_undegraded":"2024-04-25T09:31:51.567166+0000","last_fullsized":"2024-04-25T09:31:51.567166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"35'119","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.105596+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:31:51.105596+0000","last_peered":"2024-04-25T09:31:51.105596+0000","last_clean":"2024-04-25T09:31:51.105596+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:31:51.105596+0000","last_undegraded":"2024-04-25T09:31:51.105596+0000","last_fullsized":"2024-04-25T09:31:51.105596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.814228+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:31:36.814228+0000","last_peered":"2024-04-25T09:31:36.814228+0000","last_clean":"2024-04-25T09:31:36.814228+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:31:36.814228+0000","last_undegraded":"2024-04-25T09:31:36.814228+0000","last_fullsized":"2024-04-25T09:31:36.814228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":20086784,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2452,"num_write_kb":19616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30040064,"data_stored":60080128,"data_compressed":3098952,"data_compressed_allocated":30040064,"data_compressed_original":60080128,"omap_allocated":0,"internal_metadata":0},"log_size":2438,"ondisk_log_size":2438,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60176,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94311664,"statfs":{"total":96636764160,"available":96575143936,"internally_reserved":0,"allocated":7151616,"data_stored":14247079,"data_compressed":728837,"data_compressed_allocated":6815744,"data_compressed_original":14123008,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61800,"kb_used_data":8608,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94310040,"statfs":{"total":96636764160,"available":96573480960,"internally_reserved":0,"allocated":8814592,"data_stored":17586170,"data_compressed":901211,"data_compressed_allocated":8486912,"data_compressed_original":17465344,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50648,"kb_used_data":5776,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94321192,"statfs":{"total":96636764160,"available":96584900608,"internally_reserved":0,"allocated":5914624,"data_stored":11331885,"data_compressed":579263,"data_compressed_allocated":5615616,"data_compressed_original":11231232,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65172,"kb_used_data":7820,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94306668,"statfs":{"total":96636764160,"available":96570028032,"internally_reserved":0,"allocated":8007680,"data_stored":15985485,"data_compressed":818802,"data_compressed_allocated":7688192,"data_compressed_original":15867904,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7966720,"data_stored":15933440,"data_compressed":821829,"data_compressed_allocated":7966720,"data_compressed_original":15933440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5980160,"data_stored":11960320,"data_compressed":616910,"data_compressed_allocated":5980160,"data_compressed_original":11960320,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8929280,"data_stored":17858560,"data_compressed":921158,"data_compressed_allocated":8929280,"data_compressed_original":17858560,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7163904,"data_stored":14327808,"data_compressed":739055,"data_compressed_allocated":7163904,"data_compressed_original":14327808,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:54.188 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:31:54.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:54.344+0000 7faa36c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:54.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:54.353+0000 7faa36c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:54.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2813 2797 1.21387 1.03906 0.0551549 0.102449 2024-04-25T09:31:54.582 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:31:54.582 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:31:54.604 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-04-25T09:31:53.719721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20677152,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2589,"num_write_kb":21510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2535,"ondisk_log_size":2535,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237796,"kb_used_data":29188,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377249564,"statfs":{"total":386547056640,"available":386303553536,"internally_reserved":0,"allocated":29888512,"data_stored":59150619,"data_compressed":3028113,"data_compressed_allocated":28606464,"data_compressed_original":58687488,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6283264,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.442841"},"pg_stats":[{"pgid":"5.f","version":"36'204","reported_seq":220,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.397390+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:31:52.397390+0000","last_peered":"2024-04-25T09:31:52.397390+0000","last_clean":"2024-04-25T09:31:52.397390+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:31:52.397390+0000","last_undegraded":"2024-04-25T09:31:52.397390+0000","last_fullsized":"2024-04-25T09:31:52.397390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1679360,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"35'87","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:48.789710+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:31:48.789710+0000","last_peered":"2024-04-25T09:31:48.789710+0000","last_clean":"2024-04-25T09:31:48.789710+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:31:48.789710+0000","last_undegraded":"2024-04-25T09:31:48.789710+0000","last_fullsized":"2024-04-25T09:31:48.789710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"35'131","reported_seq":144,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.420144+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:31:51.420144+0000","last_peered":"2024-04-25T09:31:51.420144+0000","last_clean":"2024-04-25T09:31:51.420144+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:31:51.420144+0000","last_undegraded":"2024-04-25T09:31:51.420144+0000","last_fullsized":"2024-04-25T09:31:51.420144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"36'120","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.724398+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:31:51.724398+0000","last_peered":"2024-04-25T09:31:51.724398+0000","last_clean":"2024-04-25T09:31:51.724398+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:31:51.724398+0000","last_undegraded":"2024-04-25T09:31:51.724398+0000","last_fullsized":"2024-04-25T09:31:51.724398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'119","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:50.090256+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:31:50.090256+0000","last_peered":"2024-04-25T09:31:50.090256+0000","last_clean":"2024-04-25T09:31:50.090256+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:31:50.090256+0000","last_undegraded":"2024-04-25T09:31:50.090256+0000","last_fullsized":"2024-04-25T09:31:50.090256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"36'151","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.817117+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:31:51.817117+0000","last_peered":"2024-04-25T09:31:51.817117+0000","last_clean":"2024-04-25T09:31:51.817117+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:31:51.817117+0000","last_undegraded":"2024-04-25T09:31:51.817117+0000","last_fullsized":"2024-04-25T09:31:51.817117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"35'142","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.407197+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:31:51.407197+0000","last_peered":"2024-04-25T09:31:51.407197+0000","last_clean":"2024-04-25T09:31:51.407197+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:31:51.407197+0000","last_undegraded":"2024-04-25T09:31:51.407197+0000","last_fullsized":"2024-04-25T09:31:51.407197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1171456,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"35'127","reported_seq":140,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.197730+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:31:51.197730+0000","last_peered":"2024-04-25T09:31:51.197730+0000","last_clean":"2024-04-25T09:31:51.197730+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:31:51.197730+0000","last_undegraded":"2024-04-25T09:31:51.197730+0000","last_fullsized":"2024-04-25T09:31:51.197730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"35'152","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.562380+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:31:51.562380+0000","last_peered":"2024-04-25T09:31:51.562380+0000","last_clean":"2024-04-25T09:31:51.562380+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:31:51.562380+0000","last_undegraded":"2024-04-25T09:31:51.562380+0000","last_fullsized":"2024-04-25T09:31:51.562380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":205,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.729975+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:31:51.729975+0000","last_peered":"2024-04-25T09:31:51.729975+0000","last_clean":"2024-04-25T09:31:51.729975+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:31:51.729975+0000","last_undegraded":"2024-04-25T09:31:51.729975+0000","last_fullsized":"2024-04-25T09:31:51.729975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.815536+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:31:36.815536+0000","last_peered":"2024-04-25T09:31:36.815536+0000","last_clean":"2024-04-25T09:31:36.815536+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:31:36.815536+0000","last_undegraded":"2024-04-25T09:31:36.815536+0000","last_fullsized":"2024-04-25T09:31:36.815536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'183","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:50.591539+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:31:50.591539+0000","last_peered":"2024-04-25T09:31:50.591539+0000","last_clean":"2024-04-25T09:31:50.591539+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:31:50.591539+0000","last_undegraded":"2024-04-25T09:31:50.591539+0000","last_fullsized":"2024-04-25T09:31:50.591539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.462487+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:31:36.462487+0000","last_peered":"2024-04-25T09:31:36.462487+0000","last_clean":"2024-04-25T09:31:36.462487+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:31:36.462487+0000","last_undegraded":"2024-04-25T09:31:36.462487+0000","last_fullsized":"2024-04-25T09:31:36.462487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'161","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.415373+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:31:52.415373+0000","last_peered":"2024-04-25T09:31:52.415373+0000","last_clean":"2024-04-25T09:31:52.415373+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:31:52.415373+0000","last_undegraded":"2024-04-25T09:31:52.415373+0000","last_fullsized":"2024-04-25T09:31:52.415373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327104,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":1296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.812873+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:31:36.812873+0000","last_peered":"2024-04-25T09:31:36.812873+0000","last_clean":"2024-04-25T09:31:36.812873+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:31:36.812873+0000","last_undegraded":"2024-04-25T09:31:36.812873+0000","last_fullsized":"2024-04-25T09:31:36.812873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"36'156","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.402506+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:31:52.402506+0000","last_peered":"2024-04-25T09:31:52.402506+0000","last_clean":"2024-04-25T09:31:52.402506+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:31:52.402506+0000","last_undegraded":"2024-04-25T09:31:52.402506+0000","last_fullsized":"2024-04-25T09:31:52.402506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1286144,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.463669+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:31:36.463669+0000","last_peered":"2024-04-25T09:31:36.463669+0000","last_clean":"2024-04-25T09:31:36.463669+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:31:36.463669+0000","last_undegraded":"2024-04-25T09:31:36.463669+0000","last_fullsized":"2024-04-25T09:31:36.463669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'183","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.384055+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:31:52.384055+0000","last_peered":"2024-04-25T09:31:52.384055+0000","last_clean":"2024-04-25T09:31:52.384055+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:31:52.384055+0000","last_undegraded":"2024-04-25T09:31:52.384055+0000","last_fullsized":"2024-04-25T09:31:52.384055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.558209+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:31:51.558209+0000","last_peered":"2024-04-25T09:31:51.558209+0000","last_clean":"2024-04-25T09:31:51.558209+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:31:51.558209+0000","last_undegraded":"2024-04-25T09:31:51.558209+0000","last_fullsized":"2024-04-25T09:31:51.558209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"35'196","reported_seq":209,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.419351+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:31:51.419351+0000","last_peered":"2024-04-25T09:31:51.419351+0000","last_clean":"2024-04-25T09:31:51.419351+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:31:51.419351+0000","last_undegraded":"2024-04-25T09:31:51.419351+0000","last_fullsized":"2024-04-25T09:31:51.419351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613824,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":1576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.732019+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:31:51.732019+0000","last_peered":"2024-04-25T09:31:51.732019+0000","last_clean":"2024-04-25T09:31:51.732019+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:31:51.732019+0000","last_undegraded":"2024-04-25T09:31:51.732019+0000","last_fullsized":"2024-04-25T09:31:51.732019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"37'207","reported_seq":226,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.151999+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:31:52.151999+0000","last_peered":"2024-04-25T09:31:52.151999+0000","last_clean":"2024-04-25T09:31:52.151999+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:31:52.151999+0000","last_undegraded":"2024-04-25T09:31:52.151999+0000","last_fullsized":"2024-04-25T09:31:52.151999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.567166+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:31:51.567166+0000","last_peered":"2024-04-25T09:31:51.567166+0000","last_clean":"2024-04-25T09:31:51.567166+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:31:51.567166+0000","last_undegraded":"2024-04-25T09:31:51.567166+0000","last_fullsized":"2024-04-25T09:31:51.567166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"35'119","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.105596+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:31:51.105596+0000","last_peered":"2024-04-25T09:31:51.105596+0000","last_clean":"2024-04-25T09:31:51.105596+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:31:51.105596+0000","last_undegraded":"2024-04-25T09:31:51.105596+0000","last_fullsized":"2024-04-25T09:31:51.105596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.814228+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:31:36.814228+0000","last_peered":"2024-04-25T09:31:36.814228+0000","last_clean":"2024-04-25T09:31:36.814228+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:31:36.814228+0000","last_undegraded":"2024-04-25T09:31:36.814228+0000","last_fullsized":"2024-04-25T09:31:36.814228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":20086784,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2452,"num_write_kb":19616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30040064,"data_stored":60080128,"data_compressed":3098952,"data_compressed_allocated":30040064,"data_compressed_original":60080128,"omap_allocated":0,"internal_metadata":0},"log_size":2438,"ondisk_log_size":2438,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60176,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94311664,"statfs":{"total":96636764160,"available":96575143936,"internally_reserved":0,"allocated":7151616,"data_stored":14247079,"data_compressed":728837,"data_compressed_allocated":6815744,"data_compressed_original":14123008,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61800,"kb_used_data":8608,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94310040,"statfs":{"total":96636764160,"available":96573480960,"internally_reserved":0,"allocated":8814592,"data_stored":17586170,"data_compressed":901211,"data_compressed_allocated":8486912,"data_compressed_original":17465344,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50648,"kb_used_data":5776,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94321192,"statfs":{"total":96636764160,"available":96584900608,"internally_reserved":0,"allocated":5914624,"data_stored":11331885,"data_compressed":579263,"data_compressed_allocated":5615616,"data_compressed_original":11231232,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65172,"kb_used_data":7820,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94306668,"statfs":{"total":96636764160,"available":96570028032,"internally_reserved":0,"allocated":8007680,"data_stored":15985485,"data_compressed":818802,"data_compressed_allocated":7688192,"data_compressed_original":15867904,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7966720,"data_stored":15933440,"data_compressed":821829,"data_compressed_allocated":7966720,"data_compressed_original":15933440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5980160,"data_stored":11960320,"data_compressed":616910,"data_compressed_allocated":5980160,"data_compressed_original":11960320,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8929280,"data_stored":17858560,"data_compressed":921158,"data_compressed_allocated":8929280,"data_compressed_original":17858560,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7163904,"data_stored":14327808,"data_compressed":739055,"data_compressed_allocated":7163904,"data_compressed_original":14327808,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:54.606 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:31:54.606 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:54.606 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:31:54.729 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:54.739+0000 7fbf9d86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:54.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:54.748+0000 7fbf9d86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:54.950 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:31:54.951 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:31:54.966 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-04-25T09:31:53.719721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20677152,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2589,"num_write_kb":21510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2535,"ondisk_log_size":2535,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237796,"kb_used_data":29188,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377249564,"statfs":{"total":386547056640,"available":386303553536,"internally_reserved":0,"allocated":29888512,"data_stored":59150619,"data_compressed":3028113,"data_compressed_allocated":28606464,"data_compressed_original":58687488,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6283264,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.442841"},"pg_stats":[{"pgid":"5.f","version":"36'204","reported_seq":220,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.397390+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:31:52.397390+0000","last_peered":"2024-04-25T09:31:52.397390+0000","last_clean":"2024-04-25T09:31:52.397390+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:31:52.397390+0000","last_undegraded":"2024-04-25T09:31:52.397390+0000","last_fullsized":"2024-04-25T09:31:52.397390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1679360,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":1640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"35'87","reported_seq":100,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:48.789710+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:31:48.789710+0000","last_peered":"2024-04-25T09:31:48.789710+0000","last_clean":"2024-04-25T09:31:48.789710+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:31:48.789710+0000","last_undegraded":"2024-04-25T09:31:48.789710+0000","last_fullsized":"2024-04-25T09:31:48.789710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"35'131","reported_seq":144,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.420144+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:31:51.420144+0000","last_peered":"2024-04-25T09:31:51.420144+0000","last_clean":"2024-04-25T09:31:51.420144+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:31:51.420144+0000","last_undegraded":"2024-04-25T09:31:51.420144+0000","last_fullsized":"2024-04-25T09:31:51.420144+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"36'120","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.724398+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:31:51.724398+0000","last_peered":"2024-04-25T09:31:51.724398+0000","last_clean":"2024-04-25T09:31:51.724398+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:31:51.724398+0000","last_undegraded":"2024-04-25T09:31:51.724398+0000","last_fullsized":"2024-04-25T09:31:51.724398+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'119","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:50.090256+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:31:50.090256+0000","last_peered":"2024-04-25T09:31:50.090256+0000","last_clean":"2024-04-25T09:31:50.090256+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:31:50.090256+0000","last_undegraded":"2024-04-25T09:31:50.090256+0000","last_fullsized":"2024-04-25T09:31:50.090256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"36'151","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.817117+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:31:51.817117+0000","last_peered":"2024-04-25T09:31:51.817117+0000","last_clean":"2024-04-25T09:31:51.817117+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:31:51.817117+0000","last_undegraded":"2024-04-25T09:31:51.817117+0000","last_fullsized":"2024-04-25T09:31:51.817117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"35'142","reported_seq":155,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.407197+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:31:51.407197+0000","last_peered":"2024-04-25T09:31:51.407197+0000","last_clean":"2024-04-25T09:31:51.407197+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:31:51.407197+0000","last_undegraded":"2024-04-25T09:31:51.407197+0000","last_fullsized":"2024-04-25T09:31:51.407197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1171456,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":1144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"35'127","reported_seq":140,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.197730+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:31:51.197730+0000","last_peered":"2024-04-25T09:31:51.197730+0000","last_clean":"2024-04-25T09:31:51.197730+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:31:51.197730+0000","last_undegraded":"2024-04-25T09:31:51.197730+0000","last_fullsized":"2024-04-25T09:31:51.197730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"35'152","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.562380+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:31:51.562380+0000","last_peered":"2024-04-25T09:31:51.562380+0000","last_clean":"2024-04-25T09:31:51.562380+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:31:51.562380+0000","last_undegraded":"2024-04-25T09:31:51.562380+0000","last_fullsized":"2024-04-25T09:31:51.562380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":205,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.729975+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:31:51.729975+0000","last_peered":"2024-04-25T09:31:51.729975+0000","last_clean":"2024-04-25T09:31:51.729975+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:31:51.729975+0000","last_undegraded":"2024-04-25T09:31:51.729975+0000","last_fullsized":"2024-04-25T09:31:51.729975+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.815536+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:31:36.815536+0000","last_peered":"2024-04-25T09:31:36.815536+0000","last_clean":"2024-04-25T09:31:36.815536+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:31:36.815536+0000","last_undegraded":"2024-04-25T09:31:36.815536+0000","last_fullsized":"2024-04-25T09:31:36.815536+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'183","reported_seq":196,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:50.591539+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:31:50.591539+0000","last_peered":"2024-04-25T09:31:50.591539+0000","last_clean":"2024-04-25T09:31:50.591539+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:31:50.591539+0000","last_undegraded":"2024-04-25T09:31:50.591539+0000","last_fullsized":"2024-04-25T09:31:50.591539+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.462487+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:31:36.462487+0000","last_peered":"2024-04-25T09:31:36.462487+0000","last_clean":"2024-04-25T09:31:36.462487+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:31:36.462487+0000","last_undegraded":"2024-04-25T09:31:36.462487+0000","last_fullsized":"2024-04-25T09:31:36.462487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"36'161","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.415373+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:31:52.415373+0000","last_peered":"2024-04-25T09:31:52.415373+0000","last_clean":"2024-04-25T09:31:52.415373+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:31:52.415373+0000","last_undegraded":"2024-04-25T09:31:52.415373+0000","last_fullsized":"2024-04-25T09:31:52.415373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327104,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":1296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.812873+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:31:36.812873+0000","last_peered":"2024-04-25T09:31:36.812873+0000","last_clean":"2024-04-25T09:31:36.812873+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:31:36.812873+0000","last_undegraded":"2024-04-25T09:31:36.812873+0000","last_fullsized":"2024-04-25T09:31:36.812873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"36'156","reported_seq":172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.402506+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:31:52.402506+0000","last_peered":"2024-04-25T09:31:52.402506+0000","last_clean":"2024-04-25T09:31:52.402506+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:31:52.402506+0000","last_undegraded":"2024-04-25T09:31:52.402506+0000","last_fullsized":"2024-04-25T09:31:52.402506+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1286144,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":1256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.463669+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:31:36.463669+0000","last_peered":"2024-04-25T09:31:36.463669+0000","last_clean":"2024-04-25T09:31:36.463669+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:31:36.463669+0000","last_undegraded":"2024-04-25T09:31:36.463669+0000","last_fullsized":"2024-04-25T09:31:36.463669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"36'183","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.384055+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:31:52.384055+0000","last_peered":"2024-04-25T09:31:52.384055+0000","last_clean":"2024-04-25T09:31:52.384055+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:31:52.384055+0000","last_undegraded":"2024-04-25T09:31:52.384055+0000","last_fullsized":"2024-04-25T09:31:52.384055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.558209+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:31:51.558209+0000","last_peered":"2024-04-25T09:31:51.558209+0000","last_clean":"2024-04-25T09:31:51.558209+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:31:51.558209+0000","last_undegraded":"2024-04-25T09:31:51.558209+0000","last_fullsized":"2024-04-25T09:31:51.558209+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"35'196","reported_seq":209,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.419351+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:31:51.419351+0000","last_peered":"2024-04-25T09:31:51.419351+0000","last_clean":"2024-04-25T09:31:51.419351+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:31:51.419351+0000","last_undegraded":"2024-04-25T09:31:51.419351+0000","last_fullsized":"2024-04-25T09:31:51.419351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613824,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":197,"num_write_kb":1576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.732019+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:31:51.732019+0000","last_peered":"2024-04-25T09:31:51.732019+0000","last_clean":"2024-04-25T09:31:51.732019+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:31:51.732019+0000","last_undegraded":"2024-04-25T09:31:51.732019+0000","last_fullsized":"2024-04-25T09:31:51.732019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"37'207","reported_seq":226,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:31:52.151999+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:31:52.151999+0000","last_peered":"2024-04-25T09:31:52.151999+0000","last_clean":"2024-04-25T09:31:52.151999+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:31:52.151999+0000","last_undegraded":"2024-04-25T09:31:52.151999+0000","last_fullsized":"2024-04-25T09:31:52.151999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.567166+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:31:51.567166+0000","last_peered":"2024-04-25T09:31:51.567166+0000","last_clean":"2024-04-25T09:31:51.567166+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:31:51.567166+0000","last_undegraded":"2024-04-25T09:31:51.567166+0000","last_fullsized":"2024-04-25T09:31:51.567166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"35'119","reported_seq":132,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:51.105596+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:31:51.105596+0000","last_peered":"2024-04-25T09:31:51.105596+0000","last_clean":"2024-04-25T09:31:51.105596+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:31:51.105596+0000","last_undegraded":"2024-04-25T09:31:51.105596+0000","last_fullsized":"2024-04-25T09:31:51.105596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-25T09:31:36.814228+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:31:36.814228+0000","last_peered":"2024-04-25T09:31:36.814228+0000","last_clean":"2024-04-25T09:31:36.814228+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:31:36.814228+0000","last_undegraded":"2024-04-25T09:31:36.814228+0000","last_fullsized":"2024-04-25T09:31:36.814228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":20086784,"num_objects":309,"num_object_clones":0,"num_object_copies":927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2452,"num_write_kb":19616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30040064,"data_stored":60080128,"data_compressed":3098952,"data_compressed_allocated":30040064,"data_compressed_original":60080128,"omap_allocated":0,"internal_metadata":0},"log_size":2438,"ondisk_log_size":2438,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60176,"kb_used_data":6984,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94311664,"statfs":{"total":96636764160,"available":96575143936,"internally_reserved":0,"allocated":7151616,"data_stored":14247079,"data_compressed":728837,"data_compressed_allocated":6815744,"data_compressed_original":14123008,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":61800,"kb_used_data":8608,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94310040,"statfs":{"total":96636764160,"available":96573480960,"internally_reserved":0,"allocated":8814592,"data_stored":17586170,"data_compressed":901211,"data_compressed_allocated":8486912,"data_compressed_original":17465344,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50648,"kb_used_data":5776,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94321192,"statfs":{"total":96636764160,"available":96584900608,"internally_reserved":0,"allocated":5914624,"data_stored":11331885,"data_compressed":579263,"data_compressed_allocated":5615616,"data_compressed_original":11231232,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705913,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65172,"kb_used_data":7820,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94306668,"statfs":{"total":96636764160,"available":96570028032,"internally_reserved":0,"allocated":8007680,"data_stored":15985485,"data_compressed":818802,"data_compressed_allocated":7688192,"data_compressed_original":15867904,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7966720,"data_stored":15933440,"data_compressed":821829,"data_compressed_allocated":7966720,"data_compressed_original":15933440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5980160,"data_stored":11960320,"data_compressed":616910,"data_compressed_allocated":5980160,"data_compressed_original":11960320,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8929280,"data_stored":17858560,"data_compressed":921158,"data_compressed_allocated":8929280,"data_compressed_original":17858560,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7163904,"data_stored":14327808,"data_compressed":739055,"data_compressed_allocated":7163904,"data_compressed_original":14327808,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:31:55.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 2967 2951 1.2133 1.20312 0.104811 0.102594 2024-04-25T09:31:55.633 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:31:55.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:55.769+0000 7f28dff5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:55.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:55.775+0000 7f28dff5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:56.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:31:56.439650+0000 min lat: 0.0146734 max lat: 0.314019 avg lat: 0.102659 2024-04-25T09:31:56.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:31:56.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 3125 3109 1.21435 1.23438 0.114232 0.102659 2024-04-25T09:31:57.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 3284 3268 1.21567 1.24219 0.132702 0.102555 2024-04-25T09:31:57.910 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:31:58.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:58.060+0000 7fbaaeced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:58.051 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:31:58.067+0000 7fbaaeced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:31:58.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 3441 3425 1.21616 1.22656 0.149658 0.102443 2024-04-25T09:31:59.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3594 3578 1.21525 1.19531 0.222932 0.102585 2024-04-25T09:31:59.968 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:31:59.968 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:31:59.968 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:31:59.968 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:32:00.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.119+0000 7fb05af5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.116 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.131+0000 7fb05af5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.149 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:00.149 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:00.149 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:00.149 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:00.149 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:00.149 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:00.150 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:00.150 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:00.150 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:00.150 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:00.150 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:00.150 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:00.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:00.153 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:00.153 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:32:00.241 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:00.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.298+0000 7f410ae2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.315+0000 7f410ae2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.377 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.390+0000 7fe464217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.398+0000 7fe464217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.384 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:00.384 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:00.384 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:00.388 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:00.388 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:00.388 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:32:00.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3746 3730 1.21409 1.1875 0.0483615 0.10265 2024-04-25T09:32:00.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.539+0000 7f021a59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.551+0000 7f021a59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.560 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:00.560 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:00.560 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:00.561 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:00.566 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:00.567 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:00.567 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:32:00.739 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.748+0000 7f865ba6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.744 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:00.759+0000 7f865ba6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:00.772 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:00.773 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:00.775 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:00.775 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:01.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 3902 3886 1.21427 1.21875 0.0695435 0.102701 2024-04-25T09:32:02.423 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 4033 4017 1.20692 1.02344 0.0645894 0.103257 2024-04-25T09:32:02.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:02.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:02.704+0000 7fbacf59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:02.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:02.711+0000 7fbacf59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:03.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 4181 4165 1.20504 1.15625 0.0725097 0.103452 2024-04-25T09:32:04.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 4343 4327 1.2072 1.26562 0.0319814 0.103343 2024-04-25T09:32:04.948 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:05.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:05.108+0000 7f50fdc20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:05.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:05.115+0000 7f50fdc20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:05.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 4497 4481 1.20706 1.20312 0.255376 0.10327 2024-04-25T09:32:05.776 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:05.776 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:05.776 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:32:05.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:05.910+0000 7fc88555d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:05.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:05.920+0000 7fc88555d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:06.143 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:32:06.143 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:32:06.161 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-04-25T09:32:05.279980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":33120800,"num_objects":501,"num_object_clones":0,"num_object_copies":1503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":4108,"num_write_kb":33662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4052,"ondisk_log_size":4052,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":256396,"kb_used_data":47788,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377230964,"statfs":{"total":386547056640,"available":386284507136,"internally_reserved":0,"allocated":48934912,"data_stored":97072612,"data_compressed":4984065,"data_compressed_allocated":47546368,"data_compressed_original":96567296,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12443648,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1519,"num_write_kb":12152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.560259"},"pg_stats":[{"pgid":"5.f","version":"39'279","reported_seq":304,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:02.296692+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:02.296692+0000","last_peered":"2024-04-25T09:32:02.296692+0000","last_clean":"2024-04-25T09:32:02.296692+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:02.296692+0000","last_undegraded":"2024-04-25T09:32:02.296692+0000","last_fullsized":"2024-04-25T09:32:02.296692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"39'151","reported_seq":176,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.229571+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:01.229571+0000","last_peered":"2024-04-25T09:32:01.229571+0000","last_clean":"2024-04-25T09:32:01.229571+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:01.229571+0000","last_undegraded":"2024-04-25T09:32:01.229571+0000","last_fullsized":"2024-04-25T09:32:01.229571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'244","reported_seq":269,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.424482+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:01.424482+0000","last_peered":"2024-04-25T09:32:01.424482+0000","last_clean":"2024-04-25T09:32:01.424482+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:01.424482+0000","last_undegraded":"2024-04-25T09:32:01.424482+0000","last_fullsized":"2024-04-25T09:32:01.424482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007040,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":245,"num_write_kb":1960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"39'220","reported_seq":245,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:02.414256+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:02.414256+0000","last_peered":"2024-04-25T09:32:02.414256+0000","last_clean":"2024-04-25T09:32:02.414256+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:02.414256+0000","last_undegraded":"2024-04-25T09:32:02.414256+0000","last_fullsized":"2024-04-25T09:32:02.414256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1810432,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'255","reported_seq":280,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.384488+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:01.384488+0000","last_peered":"2024-04-25T09:32:01.384488+0000","last_clean":"2024-04-25T09:32:01.384488+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:01.384488+0000","last_undegraded":"2024-04-25T09:32:01.384488+0000","last_fullsized":"2024-04-25T09:32:01.384488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"39'231","reported_seq":256,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:59.708396+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:31:59.708396+0000","last_peered":"2024-04-25T09:31:59.708396+0000","last_clean":"2024-04-25T09:31:59.708396+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:31:59.708396+0000","last_undegraded":"2024-04-25T09:31:59.708396+0000","last_fullsized":"2024-04-25T09:31:59.708396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"39'239","reported_seq":264,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:00.623693+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:00.623693+0000","last_peered":"2024-04-25T09:32:00.623693+0000","last_clean":"2024-04-25T09:32:00.623693+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:00.623693+0000","last_undegraded":"2024-04-25T09:32:00.623693+0000","last_fullsized":"2024-04-25T09:32:00.623693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"39'239","reported_seq":264,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.240385+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:01.240385+0000","last_peered":"2024-04-25T09:32:01.240385+0000","last_clean":"2024-04-25T09:32:01.240385+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:01.240385+0000","last_undegraded":"2024-04-25T09:32:01.240385+0000","last_fullsized":"2024-04-25T09:32:01.240385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"39'207","reported_seq":232,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.704389+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:01.704389+0000","last_peered":"2024-04-25T09:32:01.704389+0000","last_clean":"2024-04-25T09:32:01.704389+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:01.704389+0000","last_undegraded":"2024-04-25T09:32:01.704389+0000","last_fullsized":"2024-04-25T09:32:01.704389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":211,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.590462+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:31:54.590462+0000","last_peered":"2024-04-25T09:31:54.590462+0000","last_clean":"2024-04-25T09:31:54.590462+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:31:54.590462+0000","last_undegraded":"2024-04-25T09:31:54.590462+0000","last_fullsized":"2024-04-25T09:31:54.590462+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.771945+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:31:53.771945+0000","last_peered":"2024-04-25T09:31:53.771945+0000","last_clean":"2024-04-25T09:31:53.771945+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:31:53.771945+0000","last_undegraded":"2024-04-25T09:31:53.771945+0000","last_fullsized":"2024-04-25T09:31:53.771945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'263","reported_seq":288,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.126853+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:01.126853+0000","last_peered":"2024-04-25T09:32:01.126853+0000","last_clean":"2024-04-25T09:32:01.126853+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:01.126853+0000","last_undegraded":"2024-04-25T09:32:01.126853+0000","last_fullsized":"2024-04-25T09:32:01.126853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.597100+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:31:54.597100+0000","last_peered":"2024-04-25T09:31:54.597100+0000","last_clean":"2024-04-25T09:31:54.597100+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:31:54.597100+0000","last_undegraded":"2024-04-25T09:31:54.597100+0000","last_fullsized":"2024-04-25T09:31:54.597100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'303","reported_seq":328,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:02.201967+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:02.201967+0000","last_peered":"2024-04-25T09:32:02.201967+0000","last_clean":"2024-04-25T09:32:02.201967+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:02.201967+0000","last_undegraded":"2024-04-25T09:32:02.201967+0000","last_fullsized":"2024-04-25T09:32:02.201967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.756681+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:31:53.756681+0000","last_peered":"2024-04-25T09:31:53.756681+0000","last_clean":"2024-04-25T09:31:53.756681+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:31:53.756681+0000","last_undegraded":"2024-04-25T09:31:53.756681+0000","last_fullsized":"2024-04-25T09:31:53.756681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"39'223","reported_seq":248,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.034031+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:01.034031+0000","last_peered":"2024-04-25T09:32:01.034031+0000","last_clean":"2024-04-25T09:32:01.034031+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:01.034031+0000","last_undegraded":"2024-04-25T09:32:01.034031+0000","last_fullsized":"2024-04-25T09:32:01.034031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.601414+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:31:54.601414+0000","last_peered":"2024-04-25T09:31:54.601414+0000","last_clean":"2024-04-25T09:31:54.601414+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:31:54.601414+0000","last_undegraded":"2024-04-25T09:31:54.601414+0000","last_fullsized":"2024-04-25T09:31:54.601414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'299","reported_seq":324,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:02.396556+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:02.396556+0000","last_peered":"2024-04-25T09:32:02.396556+0000","last_clean":"2024-04-25T09:32:02.396556+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:02.396556+0000","last_undegraded":"2024-04-25T09:32:02.396556+0000","last_fullsized":"2024-04-25T09:32:02.396556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2457600,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":300,"num_write_kb":2400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.606769+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:31:54.606769+0000","last_peered":"2024-04-25T09:31:54.606769+0000","last_clean":"2024-04-25T09:31:54.606769+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:31:54.606769+0000","last_undegraded":"2024-04-25T09:31:54.606769+0000","last_fullsized":"2024-04-25T09:31:54.606769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"39'273","reported_seq":298,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:01.432928+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:01.432928+0000","last_peered":"2024-04-25T09:32:01.432928+0000","last_clean":"2024-04-25T09:32:01.432928+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:01.432928+0000","last_undegraded":"2024-04-25T09:32:01.432928+0000","last_fullsized":"2024-04-25T09:32:01.432928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244608,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":2192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.600699+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:31:54.600699+0000","last_peered":"2024-04-25T09:31:54.600699+0000","last_clean":"2024-04-25T09:31:54.600699+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:31:54.600699+0000","last_undegraded":"2024-04-25T09:31:54.600699+0000","last_fullsized":"2024-04-25T09:31:54.600699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"39'314","reported_seq":339,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:02.410755+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:02.410755+0000","last_peered":"2024-04-25T09:32:02.410755+0000","last_clean":"2024-04-25T09:32:02.410755+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:02.410755+0000","last_undegraded":"2024-04-25T09:32:02.410755+0000","last_fullsized":"2024-04-25T09:32:02.410755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2580480,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":2520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.618750+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:31:54.618750+0000","last_peered":"2024-04-25T09:31:54.618750+0000","last_clean":"2024-04-25T09:31:54.618750+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:31:54.618750+0000","last_undegraded":"2024-04-25T09:31:54.618750+0000","last_fullsized":"2024-04-25T09:31:54.618750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"39'215","reported_seq":240,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:00.102558+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:00.102558+0000","last_peered":"2024-04-25T09:32:00.102558+0000","last_clean":"2024-04-25T09:32:00.102558+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:00.102558+0000","last_undegraded":"2024-04-25T09:32:00.102558+0000","last_fullsized":"2024-04-25T09:32:00.102558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.761731+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:31:53.761731+0000","last_peered":"2024-04-25T09:31:53.761731+0000","last_clean":"2024-04-25T09:31:53.761731+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:31:53.761731+0000","last_undegraded":"2024-04-25T09:31:53.761731+0000","last_fullsized":"2024-04-25T09:31:53.761731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":32530432,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3971,"num_write_kb":31768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48640000,"data_stored":97280000,"data_compressed":5019795,"data_compressed_allocated":48640000,"data_compressed_original":97280000,"omap_allocated":0,"internal_metadata":0},"log_size":3955,"ondisk_log_size":3955,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68756,"kb_used_data":11404,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303084,"statfs":{"total":96636764160,"available":96566358016,"internally_reserved":0,"allocated":11677696,"data_stored":23272961,"data_compressed":1194560,"data_compressed_allocated":11325440,"data_compressed_original":23142400,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71288,"kb_used_data":13936,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94300552,"statfs":{"total":96636764160,"available":96563765248,"internally_reserved":0,"allocated":14270464,"data_stored":28458497,"data_compressed":1462109,"data_compressed_allocated":13918208,"data_compressed_original":28327936,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58708,"kb_used_data":9676,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94313132,"statfs":{"total":96636764160,"available":96576647168,"internally_reserved":0,"allocated":9908224,"data_stored":19266529,"data_compressed":988304,"data_compressed_allocated":9576448,"data_compressed_original":19152896,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":57644,"kb_used_data":12772,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94314196,"statfs":{"total":96636764160,"available":96577736704,"internally_reserved":0,"allocated":13078528,"data_stored":26074625,"data_compressed":1339092,"data_compressed_allocated":12726272,"data_compressed_original":25944064,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13053952,"data_stored":26107904,"data_compressed":1347195,"data_compressed_allocated":13053952,"data_compressed_original":26107904,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9801728,"data_stored":19603456,"data_compressed":1011569,"data_compressed_allocated":9801728,"data_compressed_original":19603456,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14262272,"data_stored":28524544,"data_compressed":1471904,"data_compressed_allocated":14262272,"data_compressed_original":28524544,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11522048,"data_stored":23044096,"data_compressed":1189127,"data_compressed_allocated":11522048,"data_compressed_original":23044096,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:32:06.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4645 4629 1.20536 1.15625 0.0711328 0.103448 2024-04-25T09:32:07.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:07.375 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:07.388+0000 7f543455d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:07.379 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:07.395+0000 7f543455d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:07.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4807 4791 1.2073 1.26562 0.158028 0.103265 2024-04-25T09:32:08.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 4959 4943 1.20668 1.1875 0.0875941 0.103344 2024-04-25T09:32:09.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 5120 5104 1.20822 1.25781 0.0760721 0.103198 2024-04-25T09:32:09.591 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:09.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:09.725+0000 7f84f18ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:09.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:09.731+0000 7f84f18ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:10.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 5280 5264 1.20945 1.25 0.0720457 0.103168 2024-04-25T09:32:11.163 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:11.164 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:11.164 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:32:11.164 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:32:11.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.318+0000 7fb014754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:11.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.329+0000 7fb014754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:11.355 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:11.355 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:11.355 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:11.355 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:11.355 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:11.355 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:11.355 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:11.356 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:11.356 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:11.356 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:11.356 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:11.356 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:11.359 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:11.359 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:11.359 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:32:11.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 5419 5403 1.20592 1.08594 0.128248 0.103444 2024-04-25T09:32:11.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.525+0000 7f3baa06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:11.523 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.538+0000 7f3baa06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:11.566 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:11.567 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:11.569 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:11.570 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:11.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:32:11.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.741+0000 7f081e79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:11.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.755+0000 7f081e79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:11.765 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:11.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:11.768 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:11.769 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:32:11.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:11.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.938+0000 7f3ed2e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:11.938 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:11.954+0000 7f3ed2e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:12.001 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:12.002 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:12.002 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:12.002 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:12.002 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:12.005 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:12.005 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:12.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:12.044+0000 7fb7b34ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:12.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:12.053+0000 7fb7b34ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:12.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 5563 5547 1.20367 1.125 0.0637572 0.103662 2024-04-25T09:32:13.424 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5715 5699 1.20323 1.1875 0.0833906 0.103727 2024-04-25T09:32:14.240 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:14.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:14.377+0000 7f645ee2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:14.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:14.383+0000 7f645ee2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:14.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5878 5862 1.20507 1.27344 0.0344353 0.103518 2024-04-25T09:32:15.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 6022 6006 1.20302 1.125 0.109359 0.103682 2024-04-25T09:32:16.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:32:16.441549+0000 min lat: 0.0146734 max lat: 0.37122 avg lat: 0.103819 2024-04-25T09:32:16.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:32:16.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 6169 6153 1.20165 1.14844 0.083441 0.103819 2024-04-25T09:32:16.531 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:16.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:16.661+0000 7fe43566d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:16.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:16.667+0000 7fe43566d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:17.006 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:17.006 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:32:17.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:17.148+0000 7fbc1346d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:17.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:17.159+0000 7fbc1346d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:17.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 6306 6290 1.19844 1.07031 0.0717693 0.104124 2024-04-25T09:32:18.330 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:32:18.348 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:32:18.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 6443 6427 1.19539 1.07031 0.113006 0.104342 2024-04-25T09:32:18.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:18.482+0000 7f2786a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:18.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:18.496+0000 7f2786a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:18.788 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:18.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:18.938+0000 7fe955c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:18.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:18.944+0000 7fe955c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:19.335 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:32:19.359 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:32:19.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 6583 6567 1.19302 1.09375 0.102426 0.104622 2024-04-25T09:32:19.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:19.509+0000 7f2dce39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:19.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:19.519+0000 7f2dce39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:20.342 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:32:20.361 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:32:20.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 6729 6713 1.19183 1.14062 0.183778 0.104718 2024-04-25T09:32:20.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:20.501+0000 7f536e22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:20.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:20.513+0000 7f536e22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:21.109 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:21.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:21.256+0000 7f7a51c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:21.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:21.265+0000 7f7a51c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:21.349 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:32:21.367 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:32:21.367 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:32:21.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 6876 6860 1.19086 1.14844 0.140348 0.104769 2024-04-25T09:32:21.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:21.518+0000 7f2cec39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:21.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:21.529+0000 7f2cec39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:21.759 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:32:21.760 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:32:21.776 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-04-25T09:32:21.366276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":51675680,"num_objects":782,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6373,"num_write_kb":51782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6317,"ondisk_log_size":6317,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":279412,"kb_used_data":74964,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377207948,"statfs":{"total":386547056640,"available":386260938752,"internally_reserved":0,"allocated":76763136,"data_stored":152729060,"data_compressed":7857927,"data_compressed_allocated":75374592,"data_compressed_original":152223744,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3432448,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":3352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.083987"},"pg_stats":[{"pgid":"5.f","version":"39'524","reported_seq":549,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.414337+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:17.414337+0000","last_peered":"2024-04-25T09:32:17.414337+0000","last_clean":"2024-04-25T09:32:17.414337+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:17.414337+0000","last_undegraded":"2024-04-25T09:32:17.414337+0000","last_fullsized":"2024-04-25T09:32:17.414337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4300800,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"39'287","reported_seq":312,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:13.652903+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:13.652903+0000","last_peered":"2024-04-25T09:32:13.652903+0000","last_clean":"2024-04-25T09:32:13.652903+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:13.652903+0000","last_undegraded":"2024-04-25T09:32:13.652903+0000","last_fullsized":"2024-04-25T09:32:13.652903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'399","reported_seq":424,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.331295+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:15.331295+0000","last_peered":"2024-04-25T09:32:15.331295+0000","last_clean":"2024-04-25T09:32:15.331295+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:15.331295+0000","last_undegraded":"2024-04-25T09:32:15.331295+0000","last_fullsized":"2024-04-25T09:32:15.331295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"39'319","reported_seq":344,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:14.168899+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:14.168899+0000","last_peered":"2024-04-25T09:32:14.168899+0000","last_clean":"2024-04-25T09:32:14.168899+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:14.168899+0000","last_undegraded":"2024-04-25T09:32:14.168899+0000","last_fullsized":"2024-04-25T09:32:14.168899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'375","reported_seq":400,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.682878+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:15.682878+0000","last_peered":"2024-04-25T09:32:15.682878+0000","last_clean":"2024-04-25T09:32:15.682878+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:15.682878+0000","last_undegraded":"2024-04-25T09:32:15.682878+0000","last_fullsized":"2024-04-25T09:32:15.682878+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"39'383","reported_seq":408,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.918493+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:32:16.918493+0000","last_peered":"2024-04-25T09:32:16.918493+0000","last_clean":"2024-04-25T09:32:16.918493+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:32:16.918493+0000","last_undegraded":"2024-04-25T09:32:16.918493+0000","last_fullsized":"2024-04-25T09:32:16.918493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"39'327","reported_seq":352,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.574880+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:15.574880+0000","last_peered":"2024-04-25T09:32:15.574880+0000","last_clean":"2024-04-25T09:32:15.574880+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:15.574880+0000","last_undegraded":"2024-04-25T09:32:15.574880+0000","last_fullsized":"2024-04-25T09:32:15.574880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"39'383","reported_seq":408,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.003725+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:16.003725+0000","last_peered":"2024-04-25T09:32:16.003725+0000","last_clean":"2024-04-25T09:32:16.003725+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:16.003725+0000","last_undegraded":"2024-04-25T09:32:16.003725+0000","last_fullsized":"2024-04-25T09:32:16.003725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"39'327","reported_seq":352,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:14.828044+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:14.828044+0000","last_peered":"2024-04-25T09:32:14.828044+0000","last_clean":"2024-04-25T09:32:14.828044+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:14.828044+0000","last_undegraded":"2024-04-25T09:32:14.828044+0000","last_fullsized":"2024-04-25T09:32:14.828044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":211,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.590462+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:31:54.590462+0000","last_peered":"2024-04-25T09:31:54.590462+0000","last_clean":"2024-04-25T09:31:54.590462+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:31:54.590462+0000","last_undegraded":"2024-04-25T09:31:54.590462+0000","last_fullsized":"2024-04-25T09:31:54.590462+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.771945+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:31:53.771945+0000","last_peered":"2024-04-25T09:31:53.771945+0000","last_clean":"2024-04-25T09:31:53.771945+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:31:53.771945+0000","last_undegraded":"2024-04-25T09:31:53.771945+0000","last_fullsized":"2024-04-25T09:31:53.771945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'399","reported_seq":424,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.756338+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:15.756338+0000","last_peered":"2024-04-25T09:32:15.756338+0000","last_clean":"2024-04-25T09:32:15.756338+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:15.756338+0000","last_undegraded":"2024-04-25T09:32:15.756338+0000","last_fullsized":"2024-04-25T09:32:15.756338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.597100+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:31:54.597100+0000","last_peered":"2024-04-25T09:31:54.597100+0000","last_clean":"2024-04-25T09:31:54.597100+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:31:54.597100+0000","last_undegraded":"2024-04-25T09:31:54.597100+0000","last_fullsized":"2024-04-25T09:31:54.597100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'415","reported_seq":440,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.089994+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:17.089994+0000","last_peered":"2024-04-25T09:32:17.089994+0000","last_clean":"2024-04-25T09:32:17.089994+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:17.089994+0000","last_undegraded":"2024-04-25T09:32:17.089994+0000","last_fullsized":"2024-04-25T09:32:17.089994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.756681+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:31:53.756681+0000","last_peered":"2024-04-25T09:31:53.756681+0000","last_clean":"2024-04-25T09:31:53.756681+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:31:53.756681+0000","last_undegraded":"2024-04-25T09:31:53.756681+0000","last_fullsized":"2024-04-25T09:31:53.756681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"39'375","reported_seq":400,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.225075+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:17.225075+0000","last_peered":"2024-04-25T09:32:17.225075+0000","last_clean":"2024-04-25T09:32:17.225075+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:17.225075+0000","last_undegraded":"2024-04-25T09:32:17.225075+0000","last_fullsized":"2024-04-25T09:32:17.225075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.601414+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:31:54.601414+0000","last_peered":"2024-04-25T09:31:54.601414+0000","last_clean":"2024-04-25T09:31:54.601414+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:31:54.601414+0000","last_undegraded":"2024-04-25T09:31:54.601414+0000","last_fullsized":"2024-04-25T09:31:54.601414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'447","reported_seq":472,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.386845+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:16.386845+0000","last_peered":"2024-04-25T09:32:16.386845+0000","last_clean":"2024-04-25T09:32:16.386845+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:16.386845+0000","last_undegraded":"2024-04-25T09:32:16.386845+0000","last_fullsized":"2024-04-25T09:32:16.386845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.606769+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:31:54.606769+0000","last_peered":"2024-04-25T09:31:54.606769+0000","last_clean":"2024-04-25T09:31:54.606769+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:31:54.606769+0000","last_undegraded":"2024-04-25T09:31:54.606769+0000","last_fullsized":"2024-04-25T09:31:54.606769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"39'438","reported_seq":463,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.425436+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:16.425436+0000","last_peered":"2024-04-25T09:32:16.425436+0000","last_clean":"2024-04-25T09:32:16.425436+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:16.425436+0000","last_undegraded":"2024-04-25T09:32:16.425436+0000","last_fullsized":"2024-04-25T09:32:16.425436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3596288,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.600699+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:31:54.600699+0000","last_peered":"2024-04-25T09:31:54.600699+0000","last_clean":"2024-04-25T09:31:54.600699+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:31:54.600699+0000","last_undegraded":"2024-04-25T09:31:54.600699+0000","last_fullsized":"2024-04-25T09:31:54.600699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"39'463","reported_seq":488,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.158421+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:17.158421+0000","last_peered":"2024-04-25T09:32:17.158421+0000","last_clean":"2024-04-25T09:32:17.158421+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:17.158421+0000","last_undegraded":"2024-04-25T09:32:17.158421+0000","last_fullsized":"2024-04-25T09:32:17.158421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.618750+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:31:54.618750+0000","last_peered":"2024-04-25T09:31:54.618750+0000","last_clean":"2024-04-25T09:31:54.618750+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:31:54.618750+0000","last_undegraded":"2024-04-25T09:31:54.618750+0000","last_fullsized":"2024-04-25T09:31:54.618750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"39'359","reported_seq":384,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.213814+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:16.213814+0000","last_peered":"2024-04-25T09:32:16.213814+0000","last_clean":"2024-04-25T09:32:16.213814+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:16.213814+0000","last_undegraded":"2024-04-25T09:32:16.213814+0000","last_fullsized":"2024-04-25T09:32:16.213814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.761731+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:31:53.761731+0000","last_peered":"2024-04-25T09:31:53.761731+0000","last_clean":"2024-04-25T09:31:53.761731+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:31:53.761731+0000","last_undegraded":"2024-04-25T09:31:53.761731+0000","last_fullsized":"2024-04-25T09:31:53.761731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":51085312,"num_objects":780,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6236,"num_write_kb":49888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76595200,"data_stored":153190400,"data_compressed":7906770,"data_compressed_allocated":76595200,"data_compressed_original":153190400,"omap_allocated":0,"internal_metadata":0},"log_size":6220,"ondisk_log_size":6220,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66976,"kb_used_data":17944,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94304864,"statfs":{"total":96636764160,"available":96568180736,"internally_reserved":0,"allocated":18374656,"data_stored":36666881,"data_compressed":1886165,"data_compressed_allocated":18022400,"data_compressed_original":36536320,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70868,"kb_used_data":21836,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94300972,"statfs":{"total":96636764160,"available":96564195328,"internally_reserved":0,"allocated":22360064,"data_stored":44637697,"data_compressed":2297534,"data_compressed_allocated":22007808,"data_compressed_original":44507136,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68188,"kb_used_data":14996,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94303652,"statfs":{"total":96636764160,"available":96566939648,"internally_reserved":0,"allocated":15355904,"data_stored":30161889,"data_compressed":1550894,"data_compressed_allocated":15024128,"data_compressed_original":30048256,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73380,"kb_used_data":20188,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94298460,"statfs":{"total":96636764160,"available":96561623040,"internally_reserved":0,"allocated":20672512,"data_stored":41262593,"data_compressed":2123334,"data_compressed_allocated":20320256,"data_compressed_original":41132032,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20566016,"data_stored":41132032,"data_compressed":2122977,"data_compressed_allocated":20566016,"data_compressed_original":41132032,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15360000,"data_stored":30720000,"data_compressed":1585580,"data_compressed_allocated":15360000,"data_compressed_original":30720000,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22368256,"data_stored":44736512,"data_compressed":2309021,"data_compressed_allocated":22368256,"data_compressed_original":44736512,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18300928,"data_stored":36601856,"data_compressed":1889192,"data_compressed_allocated":18300928,"data_compressed_original":36601856,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:32:21.777 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:32:21.894 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:21.904+0000 7fce91664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:21.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:21.914+0000 7fce91664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.212 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:32:22.212 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:32:22.235 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-04-25T09:32:21.366276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":51675680,"num_objects":782,"num_object_clones":0,"num_object_copies":2346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6373,"num_write_kb":51782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6317,"ondisk_log_size":6317,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":279412,"kb_used_data":74964,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377207948,"statfs":{"total":386547056640,"available":386260938752,"internally_reserved":0,"allocated":76763136,"data_stored":152729060,"data_compressed":7857927,"data_compressed_allocated":75374592,"data_compressed_original":152223744,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3432448,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":419,"num_write_kb":3352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.083987"},"pg_stats":[{"pgid":"5.f","version":"39'524","reported_seq":549,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.414337+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:17.414337+0000","last_peered":"2024-04-25T09:32:17.414337+0000","last_clean":"2024-04-25T09:32:17.414337+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:17.414337+0000","last_undegraded":"2024-04-25T09:32:17.414337+0000","last_fullsized":"2024-04-25T09:32:17.414337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4300800,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"39'287","reported_seq":312,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:13.652903+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:13.652903+0000","last_peered":"2024-04-25T09:32:13.652903+0000","last_clean":"2024-04-25T09:32:13.652903+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:13.652903+0000","last_undegraded":"2024-04-25T09:32:13.652903+0000","last_fullsized":"2024-04-25T09:32:13.652903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'399","reported_seq":424,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.331295+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:15.331295+0000","last_peered":"2024-04-25T09:32:15.331295+0000","last_clean":"2024-04-25T09:32:15.331295+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:15.331295+0000","last_undegraded":"2024-04-25T09:32:15.331295+0000","last_fullsized":"2024-04-25T09:32:15.331295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"39'319","reported_seq":344,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:14.168899+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:14.168899+0000","last_peered":"2024-04-25T09:32:14.168899+0000","last_clean":"2024-04-25T09:32:14.168899+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:14.168899+0000","last_undegraded":"2024-04-25T09:32:14.168899+0000","last_fullsized":"2024-04-25T09:32:14.168899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'375","reported_seq":400,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.682878+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:15.682878+0000","last_peered":"2024-04-25T09:32:15.682878+0000","last_clean":"2024-04-25T09:32:15.682878+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:15.682878+0000","last_undegraded":"2024-04-25T09:32:15.682878+0000","last_fullsized":"2024-04-25T09:32:15.682878+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"39'383","reported_seq":408,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.918493+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:32:16.918493+0000","last_peered":"2024-04-25T09:32:16.918493+0000","last_clean":"2024-04-25T09:32:16.918493+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:32:16.918493+0000","last_undegraded":"2024-04-25T09:32:16.918493+0000","last_fullsized":"2024-04-25T09:32:16.918493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"39'327","reported_seq":352,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.574880+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:15.574880+0000","last_peered":"2024-04-25T09:32:15.574880+0000","last_clean":"2024-04-25T09:32:15.574880+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:15.574880+0000","last_undegraded":"2024-04-25T09:32:15.574880+0000","last_fullsized":"2024-04-25T09:32:15.574880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"39'383","reported_seq":408,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.003725+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:16.003725+0000","last_peered":"2024-04-25T09:32:16.003725+0000","last_clean":"2024-04-25T09:32:16.003725+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:16.003725+0000","last_undegraded":"2024-04-25T09:32:16.003725+0000","last_fullsized":"2024-04-25T09:32:16.003725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"39'327","reported_seq":352,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:14.828044+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:14.828044+0000","last_peered":"2024-04-25T09:32:14.828044+0000","last_clean":"2024-04-25T09:32:14.828044+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:14.828044+0000","last_undegraded":"2024-04-25T09:32:14.828044+0000","last_fullsized":"2024-04-25T09:32:14.828044+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":211,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.590462+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:31:54.590462+0000","last_peered":"2024-04-25T09:31:54.590462+0000","last_clean":"2024-04-25T09:31:54.590462+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:31:54.590462+0000","last_undegraded":"2024-04-25T09:31:54.590462+0000","last_fullsized":"2024-04-25T09:31:54.590462+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.771945+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:31:53.771945+0000","last_peered":"2024-04-25T09:31:53.771945+0000","last_clean":"2024-04-25T09:31:53.771945+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:31:53.771945+0000","last_undegraded":"2024-04-25T09:31:53.771945+0000","last_fullsized":"2024-04-25T09:31:53.771945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'399","reported_seq":424,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:15.756338+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:15.756338+0000","last_peered":"2024-04-25T09:32:15.756338+0000","last_clean":"2024-04-25T09:32:15.756338+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:15.756338+0000","last_undegraded":"2024-04-25T09:32:15.756338+0000","last_fullsized":"2024-04-25T09:32:15.756338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.597100+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:31:54.597100+0000","last_peered":"2024-04-25T09:31:54.597100+0000","last_clean":"2024-04-25T09:31:54.597100+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:31:54.597100+0000","last_undegraded":"2024-04-25T09:31:54.597100+0000","last_fullsized":"2024-04-25T09:31:54.597100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'415","reported_seq":440,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.089994+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:17.089994+0000","last_peered":"2024-04-25T09:32:17.089994+0000","last_clean":"2024-04-25T09:32:17.089994+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:17.089994+0000","last_undegraded":"2024-04-25T09:32:17.089994+0000","last_fullsized":"2024-04-25T09:32:17.089994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.756681+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:31:53.756681+0000","last_peered":"2024-04-25T09:31:53.756681+0000","last_clean":"2024-04-25T09:31:53.756681+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:31:53.756681+0000","last_undegraded":"2024-04-25T09:31:53.756681+0000","last_fullsized":"2024-04-25T09:31:53.756681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"39'375","reported_seq":400,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.225075+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:17.225075+0000","last_peered":"2024-04-25T09:32:17.225075+0000","last_clean":"2024-04-25T09:32:17.225075+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:17.225075+0000","last_undegraded":"2024-04-25T09:32:17.225075+0000","last_fullsized":"2024-04-25T09:32:17.225075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.601414+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:31:54.601414+0000","last_peered":"2024-04-25T09:31:54.601414+0000","last_clean":"2024-04-25T09:31:54.601414+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:31:54.601414+0000","last_undegraded":"2024-04-25T09:31:54.601414+0000","last_fullsized":"2024-04-25T09:31:54.601414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'447","reported_seq":472,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.386845+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:16.386845+0000","last_peered":"2024-04-25T09:32:16.386845+0000","last_clean":"2024-04-25T09:32:16.386845+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:16.386845+0000","last_undegraded":"2024-04-25T09:32:16.386845+0000","last_fullsized":"2024-04-25T09:32:16.386845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.606769+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:31:54.606769+0000","last_peered":"2024-04-25T09:31:54.606769+0000","last_clean":"2024-04-25T09:31:54.606769+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:31:54.606769+0000","last_undegraded":"2024-04-25T09:31:54.606769+0000","last_fullsized":"2024-04-25T09:31:54.606769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"39'438","reported_seq":463,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.425436+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:16.425436+0000","last_peered":"2024-04-25T09:32:16.425436+0000","last_clean":"2024-04-25T09:32:16.425436+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:16.425436+0000","last_undegraded":"2024-04-25T09:32:16.425436+0000","last_fullsized":"2024-04-25T09:32:16.425436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3596288,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":439,"num_write_kb":3512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.600699+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:31:54.600699+0000","last_peered":"2024-04-25T09:31:54.600699+0000","last_clean":"2024-04-25T09:31:54.600699+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:31:54.600699+0000","last_undegraded":"2024-04-25T09:31:54.600699+0000","last_fullsized":"2024-04-25T09:31:54.600699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"39'463","reported_seq":488,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:17.158421+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:17.158421+0000","last_peered":"2024-04-25T09:32:17.158421+0000","last_clean":"2024-04-25T09:32:17.158421+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:17.158421+0000","last_undegraded":"2024-04-25T09:32:17.158421+0000","last_fullsized":"2024-04-25T09:32:17.158421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:54.618750+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:31:54.618750+0000","last_peered":"2024-04-25T09:31:54.618750+0000","last_clean":"2024-04-25T09:31:54.618750+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:31:54.618750+0000","last_undegraded":"2024-04-25T09:31:54.618750+0000","last_fullsized":"2024-04-25T09:31:54.618750+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"39'359","reported_seq":384,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:32:16.213814+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:16.213814+0000","last_peered":"2024-04-25T09:32:16.213814+0000","last_clean":"2024-04-25T09:32:16.213814+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:16.213814+0000","last_undegraded":"2024-04-25T09:32:16.213814+0000","last_fullsized":"2024-04-25T09:32:16.213814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:31:53.761731+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:31:53.761731+0000","last_peered":"2024-04-25T09:31:53.761731+0000","last_clean":"2024-04-25T09:31:53.761731+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:31:53.761731+0000","last_undegraded":"2024-04-25T09:31:53.761731+0000","last_fullsized":"2024-04-25T09:31:53.761731+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":51085312,"num_objects":780,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6236,"num_write_kb":49888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76595200,"data_stored":153190400,"data_compressed":7906770,"data_compressed_allocated":76595200,"data_compressed_original":153190400,"omap_allocated":0,"internal_metadata":0},"log_size":6220,"ondisk_log_size":6220,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66976,"kb_used_data":17944,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94304864,"statfs":{"total":96636764160,"available":96568180736,"internally_reserved":0,"allocated":18374656,"data_stored":36666881,"data_compressed":1886165,"data_compressed_allocated":18022400,"data_compressed_original":36536320,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673234,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70868,"kb_used_data":21836,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94300972,"statfs":{"total":96636764160,"available":96564195328,"internally_reserved":0,"allocated":22360064,"data_stored":44637697,"data_compressed":2297534,"data_compressed_allocated":22007808,"data_compressed_original":44507136,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68188,"kb_used_data":14996,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94303652,"statfs":{"total":96636764160,"available":96566939648,"internally_reserved":0,"allocated":15355904,"data_stored":30161889,"data_compressed":1550894,"data_compressed_allocated":15024128,"data_compressed_original":30048256,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73380,"kb_used_data":20188,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94298460,"statfs":{"total":96636764160,"available":96561623040,"internally_reserved":0,"allocated":20672512,"data_stored":41262593,"data_compressed":2123334,"data_compressed_allocated":20320256,"data_compressed_original":41132032,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20566016,"data_stored":41132032,"data_compressed":2122977,"data_compressed_allocated":20566016,"data_compressed_original":41132032,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15360000,"data_stored":30720000,"data_compressed":1585580,"data_compressed_allocated":15360000,"data_compressed_original":30720000,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22368256,"data_stored":44736512,"data_compressed":2309021,"data_compressed_allocated":22368256,"data_compressed_original":44736512,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18300928,"data_stored":36601856,"data_compressed":1889192,"data_compressed_allocated":18300928,"data_compressed_original":36601856,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:32:22.236 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:32:22.236 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:22.237 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:32:22.237 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:32:22.380 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:22.388+0000 7f3af9b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:22.401+0000 7f3af9b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 7020 7004 1.18943 1.125 0.201927 0.104912 2024-04-25T09:32:22.451 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:22.451 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:22.451 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:22.451 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:22.452 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:22.455 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:22.455 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:22.456 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:32:22.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:22.589+0000 7f5e1655d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.583 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:22.599+0000 7f5e1655d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:22.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:22.610 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:22.610 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:22.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:22.613 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:22.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:32:22.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:22.765+0000 7f6d5f6ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:22.777+0000 7f6d5f6ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:22.829 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:22.830 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:22.832 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:22.833 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:22.833 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:32:22.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:22.995+0000 7f6f7866d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:22.991 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:23.006+0000 7f6f7866d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:23.022 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:23.022 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:23.023 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:23.023 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:23.023 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:23.023 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:23.023 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:23.023 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:23.023 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:23.024 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:23.024 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:23.024 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:23.026 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:23.026 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:23.425 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 7160 7144 1.18739 1.09375 0.163782 0.105119 2024-04-25T09:32:23.467 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:23.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:23.636+0000 7f3a58e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:23.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:23.643+0000 7f3a58e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:24.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 7301 7285 1.1856 1.10156 0.0374773 0.105248 2024-04-25T09:32:25.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 7452 7436 1.18548 1.17969 0.155263 0.105294 2024-04-25T09:32:25.817 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:25.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:25.974+0000 7ff296c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:25.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:25.982+0000 7ff296c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:26.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 7605 7589 1.18567 1.19531 0.137225 0.105254 2024-04-25T09:32:27.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 7742 7726 1.18341 1.07031 0.186949 0.105461 2024-04-25T09:32:28.027 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:28.028 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:28.028 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:32:28.169 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:28.180+0000 7fc20f99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:28.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:28.191+0000 7fc20f99d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:28.284 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:28.405 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:32:28.406 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:32:28.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:28.431+0000 7f2c65b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:28.420 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-04-25T09:32:27.284425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":60555808,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7457,"num_write_kb":60454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7401,"ondisk_log_size":7401,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":300596,"kb_used_data":87824,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377186764,"statfs":{"total":386547056640,"available":386239246336,"internally_reserved":0,"allocated":89931776,"data_stored":178908672,"data_compressed":9207720,"data_compressed_allocated":88444928,"data_compressed_original":178364416,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8880128,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1084,"num_write_kb":8672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.930509"},"pg_stats":[{"pgid":"5.f","version":"42'606","reported_seq":640,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.389994+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:22.389994+0000","last_peered":"2024-04-25T09:32:22.389994+0000","last_clean":"2024-04-25T09:32:22.389994+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:22.389994+0000","last_undegraded":"2024-04-25T09:32:22.389994+0000","last_fullsized":"2024-04-25T09:32:22.389994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4972544,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":4856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"43'343","reported_seq":376,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:25.207021+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:25.207021+0000","last_peered":"2024-04-25T09:32:25.207021+0000","last_clean":"2024-04-25T09:32:25.207021+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:25.207021+0000","last_undegraded":"2024-04-25T09:32:25.207021+0000","last_fullsized":"2024-04-25T09:32:25.207021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"43'471","reported_seq":504,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:26.240726+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:26.240726+0000","last_peered":"2024-04-25T09:32:26.240726+0000","last_clean":"2024-04-25T09:32:26.240726+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:26.240726+0000","last_undegraded":"2024-04-25T09:32:26.240726+0000","last_fullsized":"2024-04-25T09:32:26.240726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"40'375","reported_seq":403,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.529199+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:21.529199+0000","last_peered":"2024-04-25T09:32:21.529199+0000","last_clean":"2024-04-25T09:32:21.529199+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:21.529199+0000","last_undegraded":"2024-04-25T09:32:21.529199+0000","last_fullsized":"2024-04-25T09:32:21.529199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"43'503","reported_seq":536,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:26.426162+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:26.426162+0000","last_peered":"2024-04-25T09:32:26.426162+0000","last_clean":"2024-04-25T09:32:26.426162+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:26.426162+0000","last_undegraded":"2024-04-25T09:32:26.426162+0000","last_fullsized":"2024-04-25T09:32:26.426162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'439","reported_seq":473,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.237698+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:32:22.237698+0000","last_peered":"2024-04-25T09:32:22.237698+0000","last_clean":"2024-04-25T09:32:22.237698+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:32:22.237698+0000","last_undegraded":"2024-04-25T09:32:22.237698+0000","last_fullsized":"2024-04-25T09:32:22.237698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"43'399","reported_seq":432,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:25.947442+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:25.947442+0000","last_peered":"2024-04-25T09:32:25.947442+0000","last_clean":"2024-04-25T09:32:25.947442+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:25.947442+0000","last_undegraded":"2024-04-25T09:32:25.947442+0000","last_fullsized":"2024-04-25T09:32:25.947442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"43'471","reported_seq":504,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:24.868576+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:24.868576+0000","last_peered":"2024-04-25T09:32:24.868576+0000","last_clean":"2024-04-25T09:32:24.868576+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:24.868576+0000","last_undegraded":"2024-04-25T09:32:24.868576+0000","last_fullsized":"2024-04-25T09:32:24.868576+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"42'363","reported_seq":397,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.407301+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:22.407301+0000","last_peered":"2024-04-25T09:32:22.407301+0000","last_clean":"2024-04-25T09:32:22.407301+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:22.407301+0000","last_undegraded":"2024-04-25T09:32:22.407301+0000","last_fullsized":"2024-04-25T09:32:22.407301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2981888,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":364,"num_write_kb":2912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":214,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:32:18.635520+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:32:18.635520+0000","last_peered":"2024-04-25T09:32:18.635520+0000","last_clean":"2024-04-25T09:32:18.635520+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:32:18.635520+0000","last_undegraded":"2024-04-25T09:32:18.635520+0000","last_fullsized":"2024-04-25T09:32:18.635520+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.451160+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:21.451160+0000","last_peered":"2024-04-25T09:32:21.451160+0000","last_clean":"2024-04-25T09:32:21.451160+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:21.451160+0000","last_undegraded":"2024-04-25T09:32:21.451160+0000","last_fullsized":"2024-04-25T09:32:21.451160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"43'452","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:26.414253+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:26.414253+0000","last_peered":"2024-04-25T09:32:26.414253+0000","last_clean":"2024-04-25T09:32:26.414253+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:26.414253+0000","last_undegraded":"2024-04-25T09:32:26.414253+0000","last_fullsized":"2024-04-25T09:32:26.414253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3710976,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":453,"num_write_kb":3624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.520600+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:22.520600+0000","last_peered":"2024-04-25T09:32:22.520600+0000","last_clean":"2024-04-25T09:32:22.520600+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:22.520600+0000","last_undegraded":"2024-04-25T09:32:22.520600+0000","last_fullsized":"2024-04-25T09:32:22.520600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"42'447","reported_seq":481,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:20.638199+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:20.638199+0000","last_peered":"2024-04-25T09:32:20.638199+0000","last_clean":"2024-04-25T09:32:20.638199+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:20.638199+0000","last_undegraded":"2024-04-25T09:32:20.638199+0000","last_fullsized":"2024-04-25T09:32:20.638199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.447434+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:21.447434+0000","last_peered":"2024-04-25T09:32:21.447434+0000","last_clean":"2024-04-25T09:32:21.447434+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:21.447434+0000","last_undegraded":"2024-04-25T09:32:21.447434+0000","last_fullsized":"2024-04-25T09:32:21.447434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"42'423","reported_seq":457,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.069897+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:22.069897+0000","last_peered":"2024-04-25T09:32:22.069897+0000","last_clean":"2024-04-25T09:32:22.069897+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:22.069897+0000","last_undegraded":"2024-04-25T09:32:22.069897+0000","last_fullsized":"2024-04-25T09:32:22.069897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.524121+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:22.524121+0000","last_peered":"2024-04-25T09:32:22.524121+0000","last_clean":"2024-04-25T09:32:22.524121+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:22.524121+0000","last_undegraded":"2024-04-25T09:32:22.524121+0000","last_fullsized":"2024-04-25T09:32:22.524121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"42'479","reported_seq":513,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.346858+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:21.346858+0000","last_peered":"2024-04-25T09:32:21.346858+0000","last_clean":"2024-04-25T09:32:21.346858+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:21.346858+0000","last_undegraded":"2024-04-25T09:32:21.346858+0000","last_fullsized":"2024-04-25T09:32:21.346858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:20.391002+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:32:20.391002+0000","last_peered":"2024-04-25T09:32:20.391002+0000","last_clean":"2024-04-25T09:32:20.391002+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:32:20.391002+0000","last_undegraded":"2024-04-25T09:32:20.391002+0000","last_fullsized":"2024-04-25T09:32:20.391002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"43'562","reported_seq":595,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:26.409183+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:26.409183+0000","last_peered":"2024-04-25T09:32:26.409183+0000","last_clean":"2024-04-25T09:32:26.409183+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:26.409183+0000","last_undegraded":"2024-04-25T09:32:26.409183+0000","last_fullsized":"2024-04-25T09:32:26.409183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4612096,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":563,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:32:18.650155+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:32:18.650155+0000","last_peered":"2024-04-25T09:32:18.650155+0000","last_clean":"2024-04-25T09:32:18.650155+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:32:18.650155+0000","last_undegraded":"2024-04-25T09:32:18.650155+0000","last_fullsized":"2024-04-25T09:32:18.650155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"40'516","reported_seq":544,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.379456+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:22.379456+0000","last_peered":"2024-04-25T09:32:22.379456+0000","last_clean":"2024-04-25T09:32:22.379456+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:22.379456+0000","last_undegraded":"2024-04-25T09:32:22.379456+0000","last_fullsized":"2024-04-25T09:32:22.379456+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4235264,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T09:32:20.394682+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:32:20.394682+0000","last_peered":"2024-04-25T09:32:20.394682+0000","last_clean":"2024-04-25T09:32:20.394682+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:32:20.394682+0000","last_undegraded":"2024-04-25T09:32:20.394682+0000","last_fullsized":"2024-04-25T09:32:20.394682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"43'455","reported_seq":488,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:25.861023+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:25.861023+0000","last_peered":"2024-04-25T09:32:25.861023+0000","last_clean":"2024-04-25T09:32:25.861023+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:25.861023+0000","last_undegraded":"2024-04-25T09:32:25.861023+0000","last_fullsized":"2024-04-25T09:32:25.861023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.450676+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:21.450676+0000","last_peered":"2024-04-25T09:32:21.450676+0000","last_clean":"2024-04-25T09:32:21.450676+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:21.450676+0000","last_undegraded":"2024-04-25T09:32:21.450676+0000","last_fullsized":"2024-04-25T09:32:21.450676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":59965440,"num_objects":917,"num_object_clones":0,"num_object_copies":2751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7320,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89681920,"data_stored":179363840,"data_compressed":9258255,"data_compressed_allocated":89681920,"data_compressed_original":179363840,"omap_allocated":0,"internal_metadata":0},"log_size":7304,"ondisk_log_size":7304,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673239,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69092,"kb_used_data":20060,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94302748,"statfs":{"total":96636764160,"available":96566013952,"internally_reserved":0,"allocated":20541440,"data_stored":40987310,"data_compressed":2109086,"data_compressed_allocated":20180992,"data_compressed_original":40853504,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673239,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73336,"kb_used_data":24304,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94298504,"statfs":{"total":96636764160,"available":96561668096,"internally_reserved":0,"allocated":24887296,"data_stored":49652744,"data_compressed":2555987,"data_compressed_allocated":24510464,"data_compressed_original":49512448,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76016,"kb_used_data":18660,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94295824,"statfs":{"total":96636764160,"available":96558923776,"internally_reserved":0,"allocated":19107840,"data_stored":37613205,"data_compressed":1934978,"data_compressed_allocated":18743296,"data_compressed_original":37486592,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82152,"kb_used_data":24800,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94289688,"statfs":{"total":96636764160,"available":96552640512,"internally_reserved":0,"allocated":25395200,"data_stored":50655413,"data_compressed":2607669,"data_compressed_allocated":25010176,"data_compressed_original":50511872,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25305088,"data_stored":50610176,"data_compressed":2612388,"data_compressed_allocated":25305088,"data_compressed_original":50610176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19103744,"data_stored":38207488,"data_compressed":1972202,"data_compressed_allocated":19103744,"data_compressed_original":38207488,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24842240,"data_stored":49684480,"data_compressed":2564513,"data_compressed_allocated":24842240,"data_compressed_original":49684480,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20430848,"data_stored":40861696,"data_compressed":2109152,"data_compressed_allocated":20430848,"data_compressed_original":40861696,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:32:28.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:28.439+0000 7f2c65b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:28.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 7893 7877 1.18334 1.17969 0.20744 0.105486 2024-04-25T09:32:29.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 8037 8021 1.18223 1.125 0.212032 0.105599 2024-04-25T09:32:30.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 8177 8161 1.18059 1.09375 0.106604 0.105739 2024-04-25T09:32:30.645 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:30.767 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:30.780+0000 7fc55eb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:30.771 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:30.787+0000 7fc55eb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:31.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 8328 8312 1.18057 1.17969 0.0331167 0.105773 2024-04-25T09:32:32.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 8465 8449 1.1786 1.07031 0.097722 0.105941 2024-04-25T09:32:32.976 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:33.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:33.124+0000 7efe62ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:33.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:33.132+0000 7efe62ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:33.422 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:33.422 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:33.423 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:32:33.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 8605 8589 1.17711 1.09375 0.122971 0.106062 2024-04-25T09:32:33.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:33.569+0000 7efeea06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:33.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:33.579+0000 7efeea06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:33.822 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:32:33.823 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:32:33.840 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-25T09:32:33.285785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":69517856,"num_objects":1056,"num_object_clones":0,"num_object_copies":3168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8551,"num_write_kb":69206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8495,"ondisk_log_size":8495,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":348512,"kb_used_data":101056,"kb_used_omap":0,"kb_used_meta":247424,"kb_avail":377138848,"statfs":{"total":386547056640,"available":386190180352,"internally_reserved":0,"allocated":103481344,"data_stored":205955252,"data_compressed":10603620,"data_compressed_allocated":101961728,"data_compressed_original":205398016,"omap_allocated":0,"internal_metadata":253362176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17842176,"num_objects":274,"num_object_clones":0,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2178,"num_write_kb":17424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.919509"},"pg_stats":[{"pgid":"5.f","version":"43'703","reported_seq":740,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:31.601508+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:31.601508+0000","last_peered":"2024-04-25T09:32:31.601508+0000","last_clean":"2024-04-25T09:32:31.601508+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:31.601508+0000","last_undegraded":"2024-04-25T09:32:31.601508+0000","last_fullsized":"2024-04-25T09:32:31.601508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"43'407","reported_seq":440,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:29.470221+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:29.470221+0000","last_peered":"2024-04-25T09:32:29.470221+0000","last_clean":"2024-04-25T09:32:29.470221+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:29.470221+0000","last_undegraded":"2024-04-25T09:32:29.470221+0000","last_fullsized":"2024-04-25T09:32:29.470221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"43'479","reported_seq":512,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:28.976434+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:28.976434+0000","last_peered":"2024-04-25T09:32:28.976434+0000","last_clean":"2024-04-25T09:32:28.976434+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:28.976434+0000","last_undegraded":"2024-04-25T09:32:28.976434+0000","last_fullsized":"2024-04-25T09:32:28.976434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"43'423","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:31.387991+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:31.387991+0000","last_peered":"2024-04-25T09:32:31.387991+0000","last_clean":"2024-04-25T09:32:31.387991+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:31.387991+0000","last_undegraded":"2024-04-25T09:32:31.387991+0000","last_fullsized":"2024-04-25T09:32:31.387991+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"43'537","reported_seq":570,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:31.408849+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:31.408849+0000","last_peered":"2024-04-25T09:32:31.408849+0000","last_clean":"2024-04-25T09:32:31.408849+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:31.408849+0000","last_undegraded":"2024-04-25T09:32:31.408849+0000","last_fullsized":"2024-04-25T09:32:31.408849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4407296,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":538,"num_write_kb":4304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"43'527","reported_seq":564,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:31.901888+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:32:31.901888+0000","last_peered":"2024-04-25T09:32:31.901888+0000","last_clean":"2024-04-25T09:32:31.901888+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:32:31.901888+0000","last_undegraded":"2024-04-25T09:32:31.901888+0000","last_fullsized":"2024-04-25T09:32:31.901888+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"43'431","reported_seq":464,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:30.701233+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:30.701233+0000","last_peered":"2024-04-25T09:32:30.701233+0000","last_clean":"2024-04-25T09:32:30.701233+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:30.701233+0000","last_undegraded":"2024-04-25T09:32:30.701233+0000","last_fullsized":"2024-04-25T09:32:30.701233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"43'524","reported_seq":557,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:31.421872+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:31.421872+0000","last_peered":"2024-04-25T09:32:31.421872+0000","last_clean":"2024-04-25T09:32:31.421872+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:31.421872+0000","last_undegraded":"2024-04-25T09:32:31.421872+0000","last_fullsized":"2024-04-25T09:32:31.421872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4300800,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"43'473","reported_seq":510,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:32.389449+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:32.389449+0000","last_peered":"2024-04-25T09:32:32.389449+0000","last_clean":"2024-04-25T09:32:32.389449+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:32.389449+0000","last_undegraded":"2024-04-25T09:32:32.389449+0000","last_fullsized":"2024-04-25T09:32:32.389449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3883008,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":3792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":219,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.481999+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:32:22.481999+0000","last_peered":"2024-04-25T09:32:22.481999+0000","last_clean":"2024-04-25T09:32:22.481999+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:32:22.481999+0000","last_undegraded":"2024-04-25T09:32:22.481999+0000","last_fullsized":"2024-04-25T09:32:22.481999+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.451160+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:21.451160+0000","last_peered":"2024-04-25T09:32:21.451160+0000","last_clean":"2024-04-25T09:32:21.451160+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:21.451160+0000","last_undegraded":"2024-04-25T09:32:21.451160+0000","last_fullsized":"2024-04-25T09:32:21.451160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"43'487","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:31.337407+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:31.337407+0000","last_peered":"2024-04-25T09:32:31.337407+0000","last_clean":"2024-04-25T09:32:31.337407+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:31.337407+0000","last_undegraded":"2024-04-25T09:32:31.337407+0000","last_fullsized":"2024-04-25T09:32:31.337407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.520600+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:22.520600+0000","last_peered":"2024-04-25T09:32:22.520600+0000","last_clean":"2024-04-25T09:32:22.520600+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:22.520600+0000","last_undegraded":"2024-04-25T09:32:22.520600+0000","last_fullsized":"2024-04-25T09:32:22.520600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"43'535","reported_seq":572,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:32.281895+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:32.281895+0000","last_peered":"2024-04-25T09:32:32.281895+0000","last_clean":"2024-04-25T09:32:32.281895+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:32.281895+0000","last_undegraded":"2024-04-25T09:32:32.281895+0000","last_fullsized":"2024-04-25T09:32:32.281895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.447434+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:21.447434+0000","last_peered":"2024-04-25T09:32:21.447434+0000","last_clean":"2024-04-25T09:32:21.447434+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:21.447434+0000","last_undegraded":"2024-04-25T09:32:21.447434+0000","last_fullsized":"2024-04-25T09:32:21.447434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"43'519","reported_seq":556,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:32.034363+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:32.034363+0000","last_peered":"2024-04-25T09:32:32.034363+0000","last_clean":"2024-04-25T09:32:32.034363+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:32.034363+0000","last_undegraded":"2024-04-25T09:32:32.034363+0000","last_fullsized":"2024-04-25T09:32:32.034363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.524121+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:22.524121+0000","last_peered":"2024-04-25T09:32:22.524121+0000","last_clean":"2024-04-25T09:32:22.524121+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:22.524121+0000","last_undegraded":"2024-04-25T09:32:22.524121+0000","last_fullsized":"2024-04-25T09:32:22.524121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"43'591","reported_seq":628,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:32.198036+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:32.198036+0000","last_peered":"2024-04-25T09:32:32.198036+0000","last_clean":"2024-04-25T09:32:32.198036+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:32.198036+0000","last_undegraded":"2024-04-25T09:32:32.198036+0000","last_fullsized":"2024-04-25T09:32:32.198036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":88,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.522407+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:32:22.522407+0000","last_peered":"2024-04-25T09:32:22.522407+0000","last_clean":"2024-04-25T09:32:22.522407+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:32:22.522407+0000","last_undegraded":"2024-04-25T09:32:22.522407+0000","last_fullsized":"2024-04-25T09:32:22.522407+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"43'629","reported_seq":662,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:31.432989+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:31.432989+0000","last_peered":"2024-04-25T09:32:31.432989+0000","last_clean":"2024-04-25T09:32:31.432989+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:31.432989+0000","last_undegraded":"2024-04-25T09:32:31.432989+0000","last_fullsized":"2024-04-25T09:32:31.432989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160960,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.516166+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:32:22.516166+0000","last_peered":"2024-04-25T09:32:22.516166+0000","last_clean":"2024-04-25T09:32:22.516166+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:32:22.516166+0000","last_undegraded":"2024-04-25T09:32:22.516166+0000","last_fullsized":"2024-04-25T09:32:22.516166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"43'622","reported_seq":655,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:32.411824+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:32.411824+0000","last_peered":"2024-04-25T09:32:32.411824+0000","last_clean":"2024-04-25T09:32:32.411824+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:32.411824+0000","last_undegraded":"2024-04-25T09:32:32.411824+0000","last_fullsized":"2024-04-25T09:32:32.411824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5103616,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":623,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":88,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.525890+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:32:22.525890+0000","last_peered":"2024-04-25T09:32:22.525890+0000","last_clean":"2024-04-25T09:32:22.525890+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:32:22.525890+0000","last_undegraded":"2024-04-25T09:32:22.525890+0000","last_fullsized":"2024-04-25T09:32:22.525890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"43'511","reported_seq":544,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:30.838704+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:30.838704+0000","last_peered":"2024-04-25T09:32:30.838704+0000","last_clean":"2024-04-25T09:32:30.838704+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:30.838704+0000","last_undegraded":"2024-04-25T09:32:30.838704+0000","last_fullsized":"2024-04-25T09:32:30.838704+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:32:21.450676+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:21.450676+0000","last_peered":"2024-04-25T09:32:21.450676+0000","last_clean":"2024-04-25T09:32:21.450676+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:21.450676+0000","last_undegraded":"2024-04-25T09:32:21.450676+0000","last_fullsized":"2024-04-25T09:32:21.450676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":68927488,"num_objects":1054,"num_object_clones":0,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8414,"num_write_kb":67312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103096320,"data_stored":206192640,"data_compressed":10643580,"data_compressed_allocated":103096320,"data_compressed_original":206192640,"omap_allocated":0,"internal_metadata":0},"log_size":8398,"ondisk_log_size":8398,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673249,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95424,"kb_used_data":24184,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94276416,"statfs":{"total":96636764160,"available":96539049984,"internally_reserved":0,"allocated":24764416,"data_stored":49393845,"data_compressed":2542661,"data_compressed_allocated":24379392,"data_compressed_original":49250304,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673249,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86468,"kb_used_data":29116,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94285372,"statfs":{"total":96636764160,"available":96548220928,"internally_reserved":0,"allocated":29814784,"data_stored":59494581,"data_compressed":3064010,"data_compressed_allocated":29429760,"data_compressed_original":59351040,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82000,"kb_used_data":20488,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94289840,"statfs":{"total":96636764160,"available":96552796160,"internally_reserved":0,"allocated":20979712,"data_stored":41356949,"data_compressed":2128289,"data_compressed_allocated":20615168,"data_compressed_original":41230336,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84620,"kb_used_data":27268,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94287220,"statfs":{"total":96636764160,"available":96550113280,"internally_reserved":0,"allocated":27922432,"data_stored":55709877,"data_compressed":2868660,"data_compressed_allocated":27537408,"data_compressed_original":55566336,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27844608,"data_stored":55689216,"data_compressed":2874648,"data_compressed_allocated":27844608,"data_compressed_original":55689216,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20881408,"data_stored":41762816,"data_compressed":2155784,"data_compressed_allocated":20881408,"data_compressed_original":41762816,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29757440,"data_stored":59514880,"data_compressed":3072113,"data_compressed_allocated":29757440,"data_compressed_original":59514880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24612864,"data_stored":49225728,"data_compressed":2541035,"data_compressed_allocated":24612864,"data_compressed_original":49225728,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:32:34.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 8760 8744 1.17769 1.21094 0.169195 0.106004 2024-04-25T09:32:35.267 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:35.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:35.397+0000 7ff818a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:35.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:35.403+0000 7ff818a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:35.426 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 8899 8883 1.17614 1.08594 0.0663312 0.106092 2024-04-25T09:32:36.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:32:36.443356+0000 min lat: 0.0146734 max lat: 0.386567 avg lat: 0.106368 2024-04-25T09:32:36.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:32:36.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 9033 9017 1.17398 1.04688 0.181612 0.106368 2024-04-25T09:32:37.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 9167 9151 1.1719 1.04688 0.0344807 0.10643 2024-04-25T09:32:37.533 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:37.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:37.663+0000 7f3d6dead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:37.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:37.670+0000 7f3d6dead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:38.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 9309 9293 1.17089 1.10938 0.123618 0.106627 2024-04-25T09:32:38.842 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:38.842 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:38.842 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:32:38.843 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:32:38.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:38.967+0000 7fa4a40ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:38.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:38.976+0000 7fa4a40ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:38.978 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:38.979 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:38.982 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:38.982 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:38.982 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:32:39.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:39.122+0000 7fd75006d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:39.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:39.135+0000 7fd75006d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:39.174 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:39.174 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:39.174 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:39.174 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:39.174 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:39.175 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:39.175 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:39.175 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:39.175 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:39.175 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:39.175 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:39.175 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:39.177 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:39.177 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:39.178 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:32:39.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:39.340+0000 7f917626d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:39.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:39.353+0000 7f917626d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:39.360 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:39.361 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:39.364 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:39.364 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:39.364 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:32:39.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 9441 9425 1.16867 1.03125 0.207231 0.106834 2024-04-25T09:32:39.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:39.523+0000 7fba87b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:39.519 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:39.534+0000 7fba87b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:39.551 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:39.552 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:39.552 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:39.552 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:39.555 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:39.556 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:39.874 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:40.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:40.026+0000 7f565f8ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:40.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:40.033+0000 7f565f8ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:40.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 9578 9562 1.16713 1.07031 0.155402 0.106991 2024-04-25T09:32:41.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 9718 9702 1.166 1.09375 0.152717 0.10705 2024-04-25T09:32:42.301 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:42.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:42.434+0000 7f0a09b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:42.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:42.441+0000 7f0a09b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:42.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 9848 9832 1.16372 1.01562 0.118522 0.107292 2024-04-25T09:32:43.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 9972 9956 1.16081 0.96875 0.113206 0.107575 2024-04-25T09:32:44.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 10115 10099 1.16017 1.11719 0.118516 0.107652 2024-04-25T09:32:44.557 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:44.558 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:32:44.561 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:44.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:44.700+0000 7f2cb366d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:44.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:44.714+0000 7f2cb366d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:44.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:44.721+0000 7fda7ceed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:44.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:44.728+0000 7fda7ceed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:45.332 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:32:45.352 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:32:45.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 10235 10219 1.15694 0.9375 0.111253 0.107936 2024-04-25T09:32:45.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:45.493+0000 7f8ef8aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:45.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:45.504+0000 7f8ef8aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:46.337 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:32:46.355 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:32:46.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 10376 10360 1.15614 1.10156 0.328645 0.107985 2024-04-25T09:32:46.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:46.496+0000 7fde4e19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:46.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:46.509+0000 7fde4e19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:46.905 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:47.024 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:47.038+0000 7f65adb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:47.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:47.044+0000 7f65adb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:47.342 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:32:47.360 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:32:47.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 10495 10479 1.15295 0.929688 0.111432 0.108261 2024-04-25T09:32:47.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:47.504+0000 7f429946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:47.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:47.519+0000 7f429946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:48.349 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:32:48.367 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:32:48.367 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:32:48.427 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 10619 10603 1.15039 0.96875 0.079667 0.108545 2024-04-25T09:32:48.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:48.508+0000 7f48b4a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:48.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:48.519+0000 7f48b4a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:48.744 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:32:48.744 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:32:48.758 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-25T09:32:48.365765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":86147616,"num_objects":1309,"num_object_clones":0,"num_object_copies":3927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10581,"num_write_kb":85446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10528,"ondisk_log_size":10528,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331560,"kb_used_data":125704,"kb_used_omap":0,"kb_used_meta":205824,"kb_avail":377155800,"statfs":{"total":386547056640,"available":386207539200,"internally_reserved":0,"allocated":128720896,"data_stored":256381800,"data_compressed":13206762,"data_compressed_allocated":127168512,"data_compressed_original":255811584,"omap_allocated":0,"internal_metadata":210763776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5185536,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":633,"num_write_kb":5064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077849"},"pg_stats":[{"pgid":"5.f","version":"45'854","reported_seq":895,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.391120+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:47.391120+0000","last_peered":"2024-04-25T09:32:47.391120+0000","last_clean":"2024-04-25T09:32:47.391120+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:47.391120+0000","last_undegraded":"2024-04-25T09:32:47.391120+0000","last_fullsized":"2024-04-25T09:32:47.391120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7004160,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"43'543","reported_seq":576,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.343064+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:46.343064+0000","last_peered":"2024-04-25T09:32:46.343064+0000","last_clean":"2024-04-25T09:32:46.343064+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:46.343064+0000","last_undegraded":"2024-04-25T09:32:46.343064+0000","last_fullsized":"2024-04-25T09:32:46.343064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"43'615","reported_seq":648,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.575609+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:45.575609+0000","last_peered":"2024-04-25T09:32:45.575609+0000","last_clean":"2024-04-25T09:32:45.575609+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:45.575609+0000","last_undegraded":"2024-04-25T09:32:45.575609+0000","last_fullsized":"2024-04-25T09:32:45.575609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"44'552","reported_seq":590,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.468054+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:46.468054+0000","last_peered":"2024-04-25T09:32:46.468054+0000","last_clean":"2024-04-25T09:32:46.468054+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:46.468054+0000","last_undegraded":"2024-04-25T09:32:46.468054+0000","last_fullsized":"2024-04-25T09:32:46.468054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"43'687","reported_seq":720,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.965675+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:45.965675+0000","last_peered":"2024-04-25T09:32:45.965675+0000","last_clean":"2024-04-25T09:32:45.965675+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:45.965675+0000","last_undegraded":"2024-04-25T09:32:45.965675+0000","last_fullsized":"2024-04-25T09:32:45.965675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"45'647","reported_seq":688,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.305342+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:32:47.305342+0000","last_peered":"2024-04-25T09:32:47.305342+0000","last_clean":"2024-04-25T09:32:47.305342+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:32:47.305342+0000","last_undegraded":"2024-04-25T09:32:47.305342+0000","last_fullsized":"2024-04-25T09:32:47.305342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"45'567","reported_seq":604,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.417186+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:46.417186+0000","last_peered":"2024-04-25T09:32:46.417186+0000","last_clean":"2024-04-25T09:32:46.417186+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:46.417186+0000","last_undegraded":"2024-04-25T09:32:46.417186+0000","last_fullsized":"2024-04-25T09:32:46.417186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"43'599","reported_seq":632,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:44.877897+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:44.877897+0000","last_peered":"2024-04-25T09:32:44.877897+0000","last_clean":"2024-04-25T09:32:44.877897+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:44.877897+0000","last_undegraded":"2024-04-25T09:32:44.877897+0000","last_fullsized":"2024-04-25T09:32:44.877897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"45'611","reported_seq":652,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.391251+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:47.391251+0000","last_peered":"2024-04-25T09:32:47.391251+0000","last_clean":"2024-04-25T09:32:47.391251+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:47.391251+0000","last_undegraded":"2024-04-25T09:32:47.391251+0000","last_fullsized":"2024-04-25T09:32:47.391251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5013504,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":225,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.463287+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:32:46.463287+0000","last_peered":"2024-04-25T09:32:46.463287+0000","last_clean":"2024-04-25T09:32:46.463287+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:32:46.463287+0000","last_undegraded":"2024-04-25T09:32:46.463287+0000","last_fullsized":"2024-04-25T09:32:46.463287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.415806+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:46.415806+0000","last_peered":"2024-04-25T09:32:46.415806+0000","last_clean":"2024-04-25T09:32:46.415806+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:46.415806+0000","last_undegraded":"2024-04-25T09:32:46.415806+0000","last_fullsized":"2024-04-25T09:32:46.415806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"43'599","reported_seq":632,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.407728+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:45.407728+0000","last_peered":"2024-04-25T09:32:45.407728+0000","last_clean":"2024-04-25T09:32:45.407728+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:45.407728+0000","last_undegraded":"2024-04-25T09:32:45.407728+0000","last_fullsized":"2024-04-25T09:32:45.407728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.520600+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:22.520600+0000","last_peered":"2024-04-25T09:32:22.520600+0000","last_clean":"2024-04-25T09:32:22.520600+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:22.520600+0000","last_undegraded":"2024-04-25T09:32:22.520600+0000","last_fullsized":"2024-04-25T09:32:22.520600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"45'735","reported_seq":776,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.017436+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:47.017436+0000","last_peered":"2024-04-25T09:32:47.017436+0000","last_clean":"2024-04-25T09:32:47.017436+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:47.017436+0000","last_undegraded":"2024-04-25T09:32:47.017436+0000","last_fullsized":"2024-04-25T09:32:47.017436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.409045+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:46.409045+0000","last_peered":"2024-04-25T09:32:46.409045+0000","last_clean":"2024-04-25T09:32:46.409045+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:46.409045+0000","last_undegraded":"2024-04-25T09:32:46.409045+0000","last_fullsized":"2024-04-25T09:32:46.409045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"45'647","reported_seq":688,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.094766+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:47.094766+0000","last_peered":"2024-04-25T09:32:47.094766+0000","last_clean":"2024-04-25T09:32:47.094766+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:47.094766+0000","last_undegraded":"2024-04-25T09:32:47.094766+0000","last_fullsized":"2024-04-25T09:32:47.094766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.524121+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:22.524121+0000","last_peered":"2024-04-25T09:32:22.524121+0000","last_clean":"2024-04-25T09:32:22.524121+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:22.524121+0000","last_undegraded":"2024-04-25T09:32:22.524121+0000","last_fullsized":"2024-04-25T09:32:22.524121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"43'688","reported_seq":728,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.478021+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:46.478021+0000","last_peered":"2024-04-25T09:32:46.478021+0000","last_clean":"2024-04-25T09:32:46.478021+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:46.478021+0000","last_undegraded":"2024-04-25T09:32:46.478021+0000","last_fullsized":"2024-04-25T09:32:46.478021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.494835+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:32:46.494835+0000","last_peered":"2024-04-25T09:32:46.494835+0000","last_clean":"2024-04-25T09:32:46.494835+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:32:46.494835+0000","last_undegraded":"2024-04-25T09:32:46.494835+0000","last_fullsized":"2024-04-25T09:32:46.494835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"43'727","reported_seq":760,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:43.307845+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:43.307845+0000","last_peered":"2024-04-25T09:32:43.307845+0000","last_clean":"2024-04-25T09:32:43.307845+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:43.307845+0000","last_undegraded":"2024-04-25T09:32:43.307845+0000","last_fullsized":"2024-04-25T09:32:43.307845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.477760+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:32:46.477760+0000","last_peered":"2024-04-25T09:32:46.477760+0000","last_clean":"2024-04-25T09:32:46.477760+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:32:46.477760+0000","last_undegraded":"2024-04-25T09:32:46.477760+0000","last_fullsized":"2024-04-25T09:32:46.477760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"44'720","reported_seq":758,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.472743+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:46.472743+0000","last_peered":"2024-04-25T09:32:46.472743+0000","last_clean":"2024-04-25T09:32:46.472743+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:46.472743+0000","last_undegraded":"2024-04-25T09:32:46.472743+0000","last_fullsized":"2024-04-25T09:32:46.472743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.498757+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:32:46.498757+0000","last_peered":"2024-04-25T09:32:46.498757+0000","last_clean":"2024-04-25T09:32:46.498757+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:32:46.498757+0000","last_undegraded":"2024-04-25T09:32:46.498757+0000","last_fullsized":"2024-04-25T09:32:46.498757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"43'640","reported_seq":673,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.378845+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:45.378845+0000","last_peered":"2024-04-25T09:32:45.378845+0000","last_clean":"2024-04-25T09:32:45.378845+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:45.378845+0000","last_undegraded":"2024-04-25T09:32:45.378845+0000","last_fullsized":"2024-04-25T09:32:45.378845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":641,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.419003+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:46.419003+0000","last_peered":"2024-04-25T09:32:46.419003+0000","last_clean":"2024-04-25T09:32:46.419003+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:46.419003+0000","last_undegraded":"2024-04-25T09:32:46.419003+0000","last_fullsized":"2024-04-25T09:32:46.419003+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":85557248,"num_objects":1307,"num_object_clones":0,"num_object_copies":3921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10444,"num_write_kb":83552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128147456,"data_stored":256294912,"data_compressed":13230648,"data_compressed_allocated":128147456,"data_compressed_original":256294912,"omap_allocated":0,"internal_metadata":0},"log_size":10431,"ondisk_log_size":10431,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92876,"kb_used_data":29956,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94278964,"statfs":{"total":96636764160,"available":96541659136,"internally_reserved":0,"allocated":30674944,"data_stored":61188623,"data_compressed":3151358,"data_compressed_allocated":30273536,"data_compressed_original":61038592,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81216,"kb_used_data":36344,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94290624,"statfs":{"total":96636764160,"available":96553598976,"internally_reserved":0,"allocated":37216256,"data_stored":74271247,"data_compressed":3826679,"data_compressed_allocated":36814848,"data_compressed_original":74121216,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74412,"kb_used_data":25380,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94297428,"statfs":{"total":96636764160,"available":96560566272,"internally_reserved":0,"allocated":25989120,"data_stored":51375765,"data_compressed":2645618,"data_compressed_allocated":25624576,"data_compressed_original":51249152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83056,"kb_used_data":34024,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94288784,"statfs":{"total":96636764160,"available":96551714816,"internally_reserved":0,"allocated":34840576,"data_stored":69546165,"data_compressed":3583107,"data_compressed_allocated":34455552,"data_compressed_original":69402624,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34754560,"data_stored":69509120,"data_compressed":3588249,"data_compressed_allocated":34754560,"data_compressed_original":69509120,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25821184,"data_stored":51642368,"data_compressed":2665922,"data_compressed_allocated":25821184,"data_compressed_original":51642368,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37105664,"data_stored":74211328,"data_compressed":3830975,"data_compressed_allocated":37105664,"data_compressed_original":74211328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30466048,"data_stored":60932096,"data_compressed":3145502,"data_compressed_allocated":30466048,"data_compressed_original":60932096,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:32:48.760 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:32:48.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:48.896+0000 7f108b86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:48.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:48.906+0000 7f108b86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.102 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:32:49.102 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:32:49.117 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-04-25T09:32:48.365765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":86147616,"num_objects":1309,"num_object_clones":0,"num_object_copies":3927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10581,"num_write_kb":85446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10528,"ondisk_log_size":10528,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331560,"kb_used_data":125704,"kb_used_omap":0,"kb_used_meta":205824,"kb_avail":377155800,"statfs":{"total":386547056640,"available":386207539200,"internally_reserved":0,"allocated":128720896,"data_stored":256381800,"data_compressed":13206762,"data_compressed_allocated":127168512,"data_compressed_original":255811584,"omap_allocated":0,"internal_metadata":210763776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5185536,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":633,"num_write_kb":5064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077849"},"pg_stats":[{"pgid":"5.f","version":"45'854","reported_seq":895,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.391120+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:47.391120+0000","last_peered":"2024-04-25T09:32:47.391120+0000","last_clean":"2024-04-25T09:32:47.391120+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:47.391120+0000","last_undegraded":"2024-04-25T09:32:47.391120+0000","last_fullsized":"2024-04-25T09:32:47.391120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7004160,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":6840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"43'543","reported_seq":576,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.343064+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:46.343064+0000","last_peered":"2024-04-25T09:32:46.343064+0000","last_clean":"2024-04-25T09:32:46.343064+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:46.343064+0000","last_undegraded":"2024-04-25T09:32:46.343064+0000","last_fullsized":"2024-04-25T09:32:46.343064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"43'615","reported_seq":648,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.575609+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:45.575609+0000","last_peered":"2024-04-25T09:32:45.575609+0000","last_clean":"2024-04-25T09:32:45.575609+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:45.575609+0000","last_undegraded":"2024-04-25T09:32:45.575609+0000","last_fullsized":"2024-04-25T09:32:45.575609+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"44'552","reported_seq":590,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.468054+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:46.468054+0000","last_peered":"2024-04-25T09:32:46.468054+0000","last_clean":"2024-04-25T09:32:46.468054+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:46.468054+0000","last_undegraded":"2024-04-25T09:32:46.468054+0000","last_fullsized":"2024-04-25T09:32:46.468054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"43'687","reported_seq":720,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.965675+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:45.965675+0000","last_peered":"2024-04-25T09:32:45.965675+0000","last_clean":"2024-04-25T09:32:45.965675+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:45.965675+0000","last_undegraded":"2024-04-25T09:32:45.965675+0000","last_fullsized":"2024-04-25T09:32:45.965675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"45'647","reported_seq":688,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.305342+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:32:47.305342+0000","last_peered":"2024-04-25T09:32:47.305342+0000","last_clean":"2024-04-25T09:32:47.305342+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:32:47.305342+0000","last_undegraded":"2024-04-25T09:32:47.305342+0000","last_fullsized":"2024-04-25T09:32:47.305342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"45'567","reported_seq":604,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.417186+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:46.417186+0000","last_peered":"2024-04-25T09:32:46.417186+0000","last_clean":"2024-04-25T09:32:46.417186+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:46.417186+0000","last_undegraded":"2024-04-25T09:32:46.417186+0000","last_fullsized":"2024-04-25T09:32:46.417186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"43'599","reported_seq":632,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:44.877897+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:44.877897+0000","last_peered":"2024-04-25T09:32:44.877897+0000","last_clean":"2024-04-25T09:32:44.877897+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:44.877897+0000","last_undegraded":"2024-04-25T09:32:44.877897+0000","last_fullsized":"2024-04-25T09:32:44.877897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"45'611","reported_seq":652,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.391251+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:47.391251+0000","last_peered":"2024-04-25T09:32:47.391251+0000","last_clean":"2024-04-25T09:32:47.391251+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:47.391251+0000","last_undegraded":"2024-04-25T09:32:47.391251+0000","last_fullsized":"2024-04-25T09:32:47.391251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5013504,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":612,"num_write_kb":4896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":225,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.463287+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:32:46.463287+0000","last_peered":"2024-04-25T09:32:46.463287+0000","last_clean":"2024-04-25T09:32:46.463287+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:32:46.463287+0000","last_undegraded":"2024-04-25T09:32:46.463287+0000","last_fullsized":"2024-04-25T09:32:46.463287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.415806+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:46.415806+0000","last_peered":"2024-04-25T09:32:46.415806+0000","last_clean":"2024-04-25T09:32:46.415806+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:46.415806+0000","last_undegraded":"2024-04-25T09:32:46.415806+0000","last_fullsized":"2024-04-25T09:32:46.415806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"43'599","reported_seq":632,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.407728+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:45.407728+0000","last_peered":"2024-04-25T09:32:45.407728+0000","last_clean":"2024-04-25T09:32:45.407728+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:45.407728+0000","last_undegraded":"2024-04-25T09:32:45.407728+0000","last_fullsized":"2024-04-25T09:32:45.407728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.520600+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:22.520600+0000","last_peered":"2024-04-25T09:32:22.520600+0000","last_clean":"2024-04-25T09:32:22.520600+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:22.520600+0000","last_undegraded":"2024-04-25T09:32:22.520600+0000","last_fullsized":"2024-04-25T09:32:22.520600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"45'735","reported_seq":776,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.017436+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:47.017436+0000","last_peered":"2024-04-25T09:32:47.017436+0000","last_clean":"2024-04-25T09:32:47.017436+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:47.017436+0000","last_undegraded":"2024-04-25T09:32:47.017436+0000","last_fullsized":"2024-04-25T09:32:47.017436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.409045+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:46.409045+0000","last_peered":"2024-04-25T09:32:46.409045+0000","last_clean":"2024-04-25T09:32:46.409045+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:46.409045+0000","last_undegraded":"2024-04-25T09:32:46.409045+0000","last_fullsized":"2024-04-25T09:32:46.409045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"45'647","reported_seq":688,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:47.094766+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:47.094766+0000","last_peered":"2024-04-25T09:32:47.094766+0000","last_clean":"2024-04-25T09:32:47.094766+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:47.094766+0000","last_undegraded":"2024-04-25T09:32:47.094766+0000","last_fullsized":"2024-04-25T09:32:47.094766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":84,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:22.524121+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:22.524121+0000","last_peered":"2024-04-25T09:32:22.524121+0000","last_clean":"2024-04-25T09:32:22.524121+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:22.524121+0000","last_undegraded":"2024-04-25T09:32:22.524121+0000","last_fullsized":"2024-04-25T09:32:22.524121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"43'688","reported_seq":728,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.478021+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:46.478021+0000","last_peered":"2024-04-25T09:32:46.478021+0000","last_clean":"2024-04-25T09:32:46.478021+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:46.478021+0000","last_undegraded":"2024-04-25T09:32:46.478021+0000","last_fullsized":"2024-04-25T09:32:46.478021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.494835+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:32:46.494835+0000","last_peered":"2024-04-25T09:32:46.494835+0000","last_clean":"2024-04-25T09:32:46.494835+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:32:46.494835+0000","last_undegraded":"2024-04-25T09:32:46.494835+0000","last_fullsized":"2024-04-25T09:32:46.494835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"43'727","reported_seq":760,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:43.307845+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:43.307845+0000","last_peered":"2024-04-25T09:32:43.307845+0000","last_clean":"2024-04-25T09:32:43.307845+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:43.307845+0000","last_undegraded":"2024-04-25T09:32:43.307845+0000","last_fullsized":"2024-04-25T09:32:43.307845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.477760+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:32:46.477760+0000","last_peered":"2024-04-25T09:32:46.477760+0000","last_clean":"2024-04-25T09:32:46.477760+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:32:46.477760+0000","last_undegraded":"2024-04-25T09:32:46.477760+0000","last_fullsized":"2024-04-25T09:32:46.477760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"44'720","reported_seq":758,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.472743+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:46.472743+0000","last_peered":"2024-04-25T09:32:46.472743+0000","last_clean":"2024-04-25T09:32:46.472743+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:46.472743+0000","last_undegraded":"2024-04-25T09:32:46.472743+0000","last_fullsized":"2024-04-25T09:32:46.472743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.498757+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:32:46.498757+0000","last_peered":"2024-04-25T09:32:46.498757+0000","last_clean":"2024-04-25T09:32:46.498757+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:32:46.498757+0000","last_undegraded":"2024-04-25T09:32:46.498757+0000","last_fullsized":"2024-04-25T09:32:46.498757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"43'640","reported_seq":673,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:32:45.378845+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:45.378845+0000","last_peered":"2024-04-25T09:32:45.378845+0000","last_clean":"2024-04-25T09:32:45.378845+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:45.378845+0000","last_undegraded":"2024-04-25T09:32:45.378845+0000","last_fullsized":"2024-04-25T09:32:45.378845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":641,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":90,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-25T09:32:46.419003+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:46.419003+0000","last_peered":"2024-04-25T09:32:46.419003+0000","last_clean":"2024-04-25T09:32:46.419003+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:46.419003+0000","last_undegraded":"2024-04-25T09:32:46.419003+0000","last_fullsized":"2024-04-25T09:32:46.419003+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":85557248,"num_objects":1307,"num_object_clones":0,"num_object_copies":3921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10444,"num_write_kb":83552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128147456,"data_stored":256294912,"data_compressed":13230648,"data_compressed_allocated":128147456,"data_compressed_original":256294912,"omap_allocated":0,"internal_metadata":0},"log_size":10431,"ondisk_log_size":10431,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92876,"kb_used_data":29956,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94278964,"statfs":{"total":96636764160,"available":96541659136,"internally_reserved":0,"allocated":30674944,"data_stored":61188623,"data_compressed":3151358,"data_compressed_allocated":30273536,"data_compressed_original":61038592,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673264,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81216,"kb_used_data":36344,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94290624,"statfs":{"total":96636764160,"available":96553598976,"internally_reserved":0,"allocated":37216256,"data_stored":74271247,"data_compressed":3826679,"data_compressed_allocated":36814848,"data_compressed_original":74121216,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74412,"kb_used_data":25380,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94297428,"statfs":{"total":96636764160,"available":96560566272,"internally_reserved":0,"allocated":25989120,"data_stored":51375765,"data_compressed":2645618,"data_compressed_allocated":25624576,"data_compressed_original":51249152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83056,"kb_used_data":34024,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94288784,"statfs":{"total":96636764160,"available":96551714816,"internally_reserved":0,"allocated":34840576,"data_stored":69546165,"data_compressed":3583107,"data_compressed_allocated":34455552,"data_compressed_original":69402624,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34754560,"data_stored":69509120,"data_compressed":3588249,"data_compressed_allocated":34754560,"data_compressed_original":69509120,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25821184,"data_stored":51642368,"data_compressed":2665922,"data_compressed_allocated":25821184,"data_compressed_original":51642368,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37105664,"data_stored":74211328,"data_compressed":3830975,"data_compressed_allocated":37105664,"data_compressed_original":74211328,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30466048,"data_stored":60932096,"data_compressed":3145502,"data_compressed_allocated":30466048,"data_compressed_original":60932096,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:32:49.118 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:32:49.118 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:49.118 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:32:49.119 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:32:49.167 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:49.252 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.262+0000 7f24c1c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.274+0000 7f24c1c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.290 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:49.290 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:49.290 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:49.290 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:49.290 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:49.291 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:49.291 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:49.291 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:49.291 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:49.291 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:49.291 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:49.291 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:49.293 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:49.294 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:49.294 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:32:49.306 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.319+0000 7fc030664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.312 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.327+0000 7fc030664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 10743 10727 1.14791 0.96875 0.287127 0.108807 2024-04-25T09:32:49.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.440+0000 7f11a775d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.452+0000 7f11a775d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.457 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:49.457 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:49.457 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:49.457 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:49.458 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:49.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:49.461 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:49.461 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:32:49.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.660+0000 7fb8e2ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.672+0000 7fb8e2ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.678 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:49.678 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:49.678 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:49.678 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:49.678 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:49.679 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:49.679 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:49.679 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:49.679 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:49.679 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:49.679 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:49.679 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:49.681 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:49.681 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:49.681 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:32:49.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.821+0000 7fb6d14ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:49.833+0000 7fb6d14ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:49.840 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:49.840 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:49.841 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:49.842 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:49.845 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:49.845 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:50.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 10866 10850 1.14538 0.960938 0.16022 0.109014 2024-04-25T09:32:51.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 10994 10978 1.14344 1 0.169122 0.109192 2024-04-25T09:32:51.551 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:51.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:51.713+0000 7f4155b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:51.705 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:51.721+0000 7f4155b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:52.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 11117 11101 1.14103 0.960938 0.118593 0.109366 2024-04-25T09:32:53.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 11254 11238 1.14012 1.07031 0.029705 0.10951 2024-04-25T09:32:53.904 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:54.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:54.055+0000 7f0eb38ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:54.048 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:54.064+0000 7f0eb38ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:54.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 11392 11376 1.13932 1.07812 0.264752 0.109612 2024-04-25T09:32:54.845 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:32:54.846 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:32:54.846 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:32:54.846 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:32:54.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:54.988+0000 7f749746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:54.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:55.001+0000 7f749746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:55.017 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:55.017 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:55.017 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:55.017 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:55.017 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:55.018 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:55.018 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:55.018 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:55.018 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:55.018 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:55.018 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:55.018 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:55.021 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:55.021 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:55.022 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:32:55.154 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:55.163+0000 7f2c4d1cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:55.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:55.175+0000 7f2c4d1cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:55.189 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:55.189 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:55.189 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:55.189 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:55.189 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:55.189 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:55.189 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:55.190 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:55.190 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:55.190 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:55.190 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:55.190 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:55.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:55.194 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:55.194 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:32:55.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:55.342+0000 7fb9c4ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:55.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:55.354+0000 7fb9c4ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:55.366 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:55.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:55.370 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:55.370 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:32:55.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 11527 11511 1.13825 1.05469 0.0872338 0.10973 2024-04-25T09:32:55.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:55.522+0000 7f9bb4d54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:55.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:55.535+0000 7f9bb4d54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:55.538 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:32:55.539 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:32:55.542 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:32:55.543 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:32:56.207 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:32:56.354 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:56.367+0000 7f5e9a00f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:56.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:56.375+0000 7f5e9a00f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:56.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:32:56.445220+0000 min lat: 0.0146734 max lat: 0.424563 avg lat: 0.110008 2024-04-25T09:32:56.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:32:56.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 16 11639 11623 1.13495 0.875 0.0284874 0.110008 2024-04-25T09:32:57.428 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 11778 11762 1.13435 1.08594 0.189431 0.110086 2024-04-25T09:32:58.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 11906 11890 1.13271 1 0.201218 0.110204 2024-04-25T09:32:58.520 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:32:58.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:58.674+0000 7f64a8ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:58.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:32:58.683+0000 7f64a8ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:32:59.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 16 12023 12007 1.13007 0.914062 0.0932925 0.110511 2024-04-25T09:33:00.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 12150 12134 1.12843 0.992188 0.11798 0.110645 2024-04-25T09:33:00.544 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:00.545 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:00.545 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:33:00.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:00.671+0000 7f65b2a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:00.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:00.681+0000 7f65b2a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:00.904 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:33:00.905 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:33:00.920 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-25T09:32:59.291466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96223776,"num_objects":1463,"num_object_clones":0,"num_object_copies":4389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11811,"num_write_kb":95286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11755,"ondisk_log_size":11755,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":377340,"kb_used_data":140956,"kb_used_omap":0,"kb_used_meta":236352,"kb_avail":377110020,"statfs":{"total":386547056640,"available":386160660480,"internally_reserved":0,"allocated":144338944,"data_stored":287460228,"data_compressed":14809506,"data_compressed_allocated":142688256,"data_compressed_original":286851072,"omap_allocated":0,"internal_metadata":242024448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10076160,"num_objects":154,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":9840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.925701"},"pg_stats":[{"pgid":"5.f","version":"47'903","reported_seq":950,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:55.969844+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:32:55.969844+0000","last_peered":"2024-04-25T09:32:55.969844+0000","last_clean":"2024-04-25T09:32:55.969844+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:32:55.969844+0000","last_undegraded":"2024-04-25T09:32:55.969844+0000","last_fullsized":"2024-04-25T09:32:55.969844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"47'591","reported_seq":634,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:53.733928+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:53.733928+0000","last_peered":"2024-04-25T09:32:53.733928+0000","last_clean":"2024-04-25T09:32:53.733928+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:53.733928+0000","last_undegraded":"2024-04-25T09:32:53.733928+0000","last_fullsized":"2024-04-25T09:32:53.733928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"47'727","reported_seq":770,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:56.278956+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:32:56.278956+0000","last_peered":"2024-04-25T09:32:56.278956+0000","last_clean":"2024-04-25T09:32:56.278956+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:32:56.278956+0000","last_undegraded":"2024-04-25T09:32:56.278956+0000","last_fullsized":"2024-04-25T09:32:56.278956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"47'591","reported_seq":636,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:57.276341+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:32:57.276341+0000","last_peered":"2024-04-25T09:32:57.276341+0000","last_clean":"2024-04-25T09:32:57.276341+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:32:57.276341+0000","last_undegraded":"2024-04-25T09:32:57.276341+0000","last_fullsized":"2024-04-25T09:32:57.276341+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"47'767","reported_seq":810,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:56.152375+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:56.152375+0000","last_peered":"2024-04-25T09:32:56.152375+0000","last_clean":"2024-04-25T09:32:56.152375+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:56.152375+0000","last_undegraded":"2024-04-25T09:32:56.152375+0000","last_fullsized":"2024-04-25T09:32:56.152375+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"47'719","reported_seq":766,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:56.996538+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:32:56.996538+0000","last_peered":"2024-04-25T09:32:56.996538+0000","last_clean":"2024-04-25T09:32:56.996538+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:32:56.996538+0000","last_undegraded":"2024-04-25T09:32:56.996538+0000","last_fullsized":"2024-04-25T09:32:56.996538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"47'679","reported_seq":722,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:56.119325+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:32:56.119325+0000","last_peered":"2024-04-25T09:32:56.119325+0000","last_clean":"2024-04-25T09:32:56.119325+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:32:56.119325+0000","last_undegraded":"2024-04-25T09:32:56.119325+0000","last_fullsized":"2024-04-25T09:32:56.119325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"47'733","reported_seq":776,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:56.416332+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:32:56.416332+0000","last_peered":"2024-04-25T09:32:56.416332+0000","last_clean":"2024-04-25T09:32:56.416332+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:32:56.416332+0000","last_undegraded":"2024-04-25T09:32:56.416332+0000","last_fullsized":"2024-04-25T09:32:56.416332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":733,"log_dups_size":0,"ondisk_log_size":733,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6012928,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":5872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"47'729","reported_seq":776,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:57.380592+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:32:57.380592+0000","last_peered":"2024-04-25T09:32:57.380592+0000","last_clean":"2024-04-25T09:32:57.380592+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:32:57.380592+0000","last_undegraded":"2024-04-25T09:32:57.380592+0000","last_fullsized":"2024-04-25T09:32:57.380592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5980160,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":5840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":231,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.375795+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:32:48.375795+0000","last_peered":"2024-04-25T09:32:48.375795+0000","last_clean":"2024-04-25T09:32:48.375795+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:32:48.375795+0000","last_undegraded":"2024-04-25T09:32:48.375795+0000","last_fullsized":"2024-04-25T09:32:48.375795+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.603043+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:50.603043+0000","last_peered":"2024-04-25T09:32:50.603043+0000","last_clean":"2024-04-25T09:32:50.603043+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:50.603043+0000","last_undegraded":"2024-04-25T09:32:50.603043+0000","last_fullsized":"2024-04-25T09:32:50.603043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"47'689","reported_seq":732,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:56.427865+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:32:56.427865+0000","last_peered":"2024-04-25T09:32:56.427865+0000","last_clean":"2024-04-25T09:32:56.427865+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:32:56.427865+0000","last_undegraded":"2024-04-25T09:32:56.427865+0000","last_fullsized":"2024-04-25T09:32:56.427865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5652480,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":690,"num_write_kb":5520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.580697+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:48.580697+0000","last_peered":"2024-04-25T09:32:48.580697+0000","last_clean":"2024-04-25T09:32:48.580697+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:48.580697+0000","last_undegraded":"2024-04-25T09:32:48.580697+0000","last_fullsized":"2024-04-25T09:32:48.580697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"47'815","reported_seq":862,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:55.707595+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:32:55.707595+0000","last_peered":"2024-04-25T09:32:55.707595+0000","last_clean":"2024-04-25T09:32:55.707595+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:32:55.707595+0000","last_undegraded":"2024-04-25T09:32:55.707595+0000","last_fullsized":"2024-04-25T09:32:55.707595+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.589023+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:50.589023+0000","last_peered":"2024-04-25T09:32:50.589023+0000","last_clean":"2024-04-25T09:32:50.589023+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:50.589023+0000","last_undegraded":"2024-04-25T09:32:50.589023+0000","last_fullsized":"2024-04-25T09:32:50.589023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"47'695","reported_seq":742,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:55.006357+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:32:55.006357+0000","last_peered":"2024-04-25T09:32:55.006357+0000","last_clean":"2024-04-25T09:32:55.006357+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:32:55.006357+0000","last_undegraded":"2024-04-25T09:32:55.006357+0000","last_fullsized":"2024-04-25T09:32:55.006357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.571482+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:48.571482+0000","last_peered":"2024-04-25T09:32:48.571482+0000","last_clean":"2024-04-25T09:32:48.571482+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:48.571482+0000","last_undegraded":"2024-04-25T09:32:48.571482+0000","last_fullsized":"2024-04-25T09:32:48.571482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"47'759","reported_seq":806,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:57.374829+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:32:57.374829+0000","last_peered":"2024-04-25T09:32:57.374829+0000","last_clean":"2024-04-25T09:32:57.374829+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:32:57.374829+0000","last_undegraded":"2024-04-25T09:32:57.374829+0000","last_fullsized":"2024-04-25T09:32:57.374829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.538583+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:32:48.538583+0000","last_peered":"2024-04-25T09:32:48.538583+0000","last_clean":"2024-04-25T09:32:48.538583+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:32:48.538583+0000","last_undegraded":"2024-04-25T09:32:48.538583+0000","last_fullsized":"2024-04-25T09:32:48.538583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"47'767","reported_seq":810,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:54.588492+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:32:54.588492+0000","last_peered":"2024-04-25T09:32:54.588492+0000","last_clean":"2024-04-25T09:32:54.588492+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:32:54.588492+0000","last_undegraded":"2024-04-25T09:32:54.588492+0000","last_fullsized":"2024-04-25T09:32:54.588492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.393265+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:32:48.393265+0000","last_peered":"2024-04-25T09:32:48.393265+0000","last_clean":"2024-04-25T09:32:48.393265+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:32:48.393265+0000","last_undegraded":"2024-04-25T09:32:48.393265+0000","last_fullsized":"2024-04-25T09:32:48.393265+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"47'751","reported_seq":796,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:54.653641+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:32:54.653641+0000","last_peered":"2024-04-25T09:32:54.653641+0000","last_clean":"2024-04-25T09:32:54.653641+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:32:54.653641+0000","last_undegraded":"2024-04-25T09:32:54.653641+0000","last_fullsized":"2024-04-25T09:32:54.653641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.539690+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:32:48.539690+0000","last_peered":"2024-04-25T09:32:48.539690+0000","last_clean":"2024-04-25T09:32:48.539690+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:32:48.539690+0000","last_undegraded":"2024-04-25T09:32:48.539690+0000","last_fullsized":"2024-04-25T09:32:48.539690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"47'743","reported_seq":786,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:56.390109+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:32:56.390109+0000","last_peered":"2024-04-25T09:32:56.390109+0000","last_clean":"2024-04-25T09:32:56.390109+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:32:56.390109+0000","last_undegraded":"2024-04-25T09:32:56.390109+0000","last_fullsized":"2024-04-25T09:32:56.390109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.614671+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:50.614671+0000","last_peered":"2024-04-25T09:32:50.614671+0000","last_clean":"2024-04-25T09:32:50.614671+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:50.614671+0000","last_undegraded":"2024-04-25T09:32:50.614671+0000","last_fullsized":"2024-04-25T09:32:50.614671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":95633408,"num_objects":1461,"num_object_clones":0,"num_object_copies":4383,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11674,"num_write_kb":93392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143589376,"data_stored":287178752,"data_compressed":14825355,"data_compressed_allocated":143589376,"data_compressed_original":287178752,"omap_allocated":0,"internal_metadata":0},"log_size":11658,"ondisk_log_size":11658,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673274,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95696,"kb_used_data":32776,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94276144,"statfs":{"total":96636764160,"available":96538771456,"internally_reserved":0,"allocated":33562624,"data_stored":66937705,"data_compressed":3447881,"data_compressed_allocated":33144832,"data_compressed_original":66781184,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673274,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89996,"kb_used_data":40964,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94281844,"statfs":{"total":96636764160,"available":96544608256,"internally_reserved":0,"allocated":41947136,"data_stored":83706729,"data_compressed":4313551,"data_compressed_allocated":41529344,"data_compressed_original":83550208,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81848,"kb_used_data":28656,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94289992,"statfs":{"total":96636764160,"available":96552951808,"internally_reserved":0,"allocated":29343744,"data_stored":58032457,"data_compressed":2988670,"data_compressed_allocated":28946432,"data_compressed_original":57892864,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109800,"kb_used_data":38560,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94262040,"statfs":{"total":96636764160,"available":96524328960,"internally_reserved":0,"allocated":39485440,"data_stored":78783337,"data_compressed":4059404,"data_compressed_allocated":39067648,"data_compressed_original":78626816,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39321600,"data_stored":78643200,"data_compressed":4059893,"data_compressed_allocated":39321600,"data_compressed_original":78643200,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29167616,"data_stored":58335232,"data_compressed":3011512,"data_compressed_allocated":29167616,"data_compressed_original":58335232,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41803776,"data_stored":83607552,"data_compressed":4316155,"data_compressed_allocated":41803776,"data_compressed_original":83607552,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33296384,"data_stored":66592768,"data_compressed":3437795,"data_compressed_allocated":33296384,"data_compressed_original":66592768,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:33:00.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:01.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:01.064+0000 7f88560ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:01.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:01.071+0000 7f88560ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:01.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 12280 12264 1.1271 1.01562 0.0624234 0.110772 2024-04-25T09:33:02.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 12418 12402 1.12653 1.07812 0.0924516 0.110863 2024-04-25T09:33:03.269 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:03.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:03.403+0000 7efe1206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:03.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:03.410+0000 7efe1206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:03.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 12555 12539 1.12588 1.07031 0.117284 0.110873 2024-04-25T09:33:04.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 12680 12664 1.12419 0.976562 0.15399 0.1111 2024-04-25T09:33:05.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 12823 12807 1.12411 1.11719 0.190797 0.111092 2024-04-25T09:33:05.599 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:05.724 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:05.738+0000 7f37d16ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:05.730 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:05.745+0000 7f37d16ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:05.922 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:05.922 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:05.922 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:33:06.068 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:06.078+0000 7f9c80857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:06.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:06.088+0000 7f9c80857640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:06.352 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:33:06.352 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:33:06.369 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-25T09:33:05.292748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":101679648,"num_objects":1546,"num_object_clones":0,"num_object_copies":4638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":12477,"num_write_kb":100614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12421,"ondisk_log_size":12421,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":433804,"kb_used_data":148840,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377053556,"statfs":{"total":386547056640,"available":386102841344,"internally_reserved":0,"allocated":152412160,"data_stored":303606660,"data_compressed":15643239,"data_compressed_allocated":150761472,"data_compressed_original":302997504,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10862592,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1326,"num_write_kb":10608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002610"},"pg_stats":[{"pgid":"5.f","version":"47'943","reported_seq":990,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:02.163581+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:33:02.163581+0000","last_peered":"2024-04-25T09:33:02.163581+0000","last_clean":"2024-04-25T09:33:02.163581+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:33:02.163581+0000","last_undegraded":"2024-04-25T09:33:02.163581+0000","last_fullsized":"2024-04-25T09:33:02.163581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":943,"log_dups_size":0,"ondisk_log_size":943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"47'631","reported_seq":674,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:59.279236+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:32:59.279236+0000","last_peered":"2024-04-25T09:32:59.279236+0000","last_clean":"2024-04-25T09:32:59.279236+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:32:59.279236+0000","last_undegraded":"2024-04-25T09:32:59.279236+0000","last_fullsized":"2024-04-25T09:32:59.279236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"47'759","reported_seq":802,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:01.401491+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:33:01.401491+0000","last_peered":"2024-04-25T09:33:01.401491+0000","last_clean":"2024-04-25T09:33:01.401491+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:33:01.401491+0000","last_undegraded":"2024-04-25T09:33:01.401491+0000","last_fullsized":"2024-04-25T09:33:01.401491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"47'615","reported_seq":660,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:02.033074+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:33:02.033074+0000","last_peered":"2024-04-25T09:33:02.033074+0000","last_clean":"2024-04-25T09:33:02.033074+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:33:02.033074+0000","last_undegraded":"2024-04-25T09:33:02.033074+0000","last_fullsized":"2024-04-25T09:33:02.033074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"47'783","reported_seq":826,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:59.602666+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:32:59.602666+0000","last_peered":"2024-04-25T09:32:59.602666+0000","last_clean":"2024-04-25T09:32:59.602666+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:32:59.602666+0000","last_undegraded":"2024-04-25T09:32:59.602666+0000","last_fullsized":"2024-04-25T09:32:59.602666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"47'767","reported_seq":814,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:01.432599+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:33:01.432599+0000","last_peered":"2024-04-25T09:33:01.432599+0000","last_clean":"2024-04-25T09:33:01.432599+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:33:01.432599+0000","last_undegraded":"2024-04-25T09:33:01.432599+0000","last_fullsized":"2024-04-25T09:33:01.432599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"47'727","reported_seq":770,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:01.149336+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:33:01.149336+0000","last_peered":"2024-04-25T09:33:01.149336+0000","last_clean":"2024-04-25T09:33:01.149336+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:33:01.149336+0000","last_undegraded":"2024-04-25T09:33:01.149336+0000","last_fullsized":"2024-04-25T09:33:01.149336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"47'794","reported_seq":837,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:01.438428+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:33:01.438428+0000","last_peered":"2024-04-25T09:33:01.438428+0000","last_clean":"2024-04-25T09:33:01.438428+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:33:01.438428+0000","last_undegraded":"2024-04-25T09:33:01.438428+0000","last_fullsized":"2024-04-25T09:33:01.438428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6512640,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":6360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"47'796","reported_seq":843,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:02.406909+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:33:02.406909+0000","last_peered":"2024-04-25T09:33:02.406909+0000","last_clean":"2024-04-25T09:33:02.406909+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:33:02.406909+0000","last_undegraded":"2024-04-25T09:33:02.406909+0000","last_fullsized":"2024-04-25T09:33:02.406909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6529024,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":6376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":231,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.375795+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:32:48.375795+0000","last_peered":"2024-04-25T09:32:48.375795+0000","last_clean":"2024-04-25T09:32:48.375795+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:32:48.375795+0000","last_undegraded":"2024-04-25T09:32:48.375795+0000","last_fullsized":"2024-04-25T09:32:48.375795+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.603043+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:50.603043+0000","last_peered":"2024-04-25T09:32:50.603043+0000","last_clean":"2024-04-25T09:32:50.603043+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:50.603043+0000","last_undegraded":"2024-04-25T09:32:50.603043+0000","last_fullsized":"2024-04-25T09:32:50.603043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"47'719","reported_seq":762,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:01.051806+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:33:01.051806+0000","last_peered":"2024-04-25T09:33:01.051806+0000","last_clean":"2024-04-25T09:33:01.051806+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:33:01.051806+0000","last_undegraded":"2024-04-25T09:33:01.051806+0000","last_fullsized":"2024-04-25T09:33:01.051806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.580697+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:48.580697+0000","last_peered":"2024-04-25T09:32:48.580697+0000","last_clean":"2024-04-25T09:32:48.580697+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:48.580697+0000","last_undegraded":"2024-04-25T09:32:48.580697+0000","last_fullsized":"2024-04-25T09:32:48.580697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"47'855","reported_seq":902,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:02.394250+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:33:02.394250+0000","last_peered":"2024-04-25T09:33:02.394250+0000","last_clean":"2024-04-25T09:33:02.394250+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:33:02.394250+0000","last_undegraded":"2024-04-25T09:33:02.394250+0000","last_fullsized":"2024-04-25T09:33:02.394250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.589023+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:50.589023+0000","last_peered":"2024-04-25T09:32:50.589023+0000","last_clean":"2024-04-25T09:32:50.589023+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:50.589023+0000","last_undegraded":"2024-04-25T09:32:50.589023+0000","last_fullsized":"2024-04-25T09:32:50.589023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"47'727","reported_seq":774,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:00.996557+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:33:00.996557+0000","last_peered":"2024-04-25T09:33:00.996557+0000","last_clean":"2024-04-25T09:33:00.996557+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:33:00.996557+0000","last_undegraded":"2024-04-25T09:33:00.996557+0000","last_fullsized":"2024-04-25T09:33:00.996557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.571482+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:48.571482+0000","last_peered":"2024-04-25T09:32:48.571482+0000","last_clean":"2024-04-25T09:32:48.571482+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:48.571482+0000","last_undegraded":"2024-04-25T09:32:48.571482+0000","last_fullsized":"2024-04-25T09:32:48.571482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"47'815","reported_seq":862,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:01.992413+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:33:01.992413+0000","last_peered":"2024-04-25T09:33:01.992413+0000","last_clean":"2024-04-25T09:33:01.992413+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:33:01.992413+0000","last_undegraded":"2024-04-25T09:33:01.992413+0000","last_fullsized":"2024-04-25T09:33:01.992413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.538583+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:32:48.538583+0000","last_peered":"2024-04-25T09:32:48.538583+0000","last_clean":"2024-04-25T09:32:48.538583+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:32:48.538583+0000","last_undegraded":"2024-04-25T09:32:48.538583+0000","last_fullsized":"2024-04-25T09:32:48.538583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"47'819","reported_seq":862,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:01.409748+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:33:01.409748+0000","last_peered":"2024-04-25T09:33:01.409748+0000","last_clean":"2024-04-25T09:33:01.409748+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:33:01.409748+0000","last_undegraded":"2024-04-25T09:33:01.409748+0000","last_fullsized":"2024-04-25T09:33:01.409748+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6717440,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":820,"num_write_kb":6560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.393265+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:32:48.393265+0000","last_peered":"2024-04-25T09:32:48.393265+0000","last_clean":"2024-04-25T09:32:48.393265+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:32:48.393265+0000","last_undegraded":"2024-04-25T09:32:48.393265+0000","last_fullsized":"2024-04-25T09:32:48.393265+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"47'791","reported_seq":836,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:00.686138+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:33:00.686138+0000","last_peered":"2024-04-25T09:33:00.686138+0000","last_clean":"2024-04-25T09:33:00.686138+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:33:00.686138+0000","last_undegraded":"2024-04-25T09:33:00.686138+0000","last_fullsized":"2024-04-25T09:33:00.686138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.539690+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:32:48.539690+0000","last_peered":"2024-04-25T09:32:48.539690+0000","last_clean":"2024-04-25T09:32:48.539690+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:32:48.539690+0000","last_undegraded":"2024-04-25T09:32:48.539690+0000","last_fullsized":"2024-04-25T09:32:48.539690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"47'783","reported_seq":826,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:00.961828+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:33:00.961828+0000","last_peered":"2024-04-25T09:33:00.961828+0000","last_clean":"2024-04-25T09:33:00.961828+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:33:00.961828+0000","last_undegraded":"2024-04-25T09:33:00.961828+0000","last_fullsized":"2024-04-25T09:33:00.961828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.614671+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:50.614671+0000","last_peered":"2024-04-25T09:32:50.614671+0000","last_clean":"2024-04-25T09:32:50.614671+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:50.614671+0000","last_undegraded":"2024-04-25T09:32:50.614671+0000","last_fullsized":"2024-04-25T09:32:50.614671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":101089280,"num_objects":1544,"num_object_clones":0,"num_object_copies":4632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12340,"num_write_kb":98720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":151654400,"data_stored":303308800,"data_compressed":15658242,"data_compressed_allocated":151654400,"data_compressed_original":303308800,"omap_allocated":0,"internal_metadata":0},"log_size":12324,"ondisk_log_size":12324,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101548,"kb_used_data":34464,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94270292,"statfs":{"total":96636764160,"available":96532779008,"internally_reserved":0,"allocated":35291136,"data_stored":70394729,"data_compressed":3626387,"data_compressed_allocated":34873344,"data_compressed_original":70238208,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673279,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114500,"kb_used_data":43260,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94257340,"statfs":{"total":96636764160,"available":96519516160,"internally_reserved":0,"allocated":44298240,"data_stored":88408937,"data_compressed":4556353,"data_compressed_allocated":43880448,"data_compressed_original":88252416,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101620,"kb_used_data":30380,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94270220,"statfs":{"total":96636764160,"available":96532705280,"internally_reserved":0,"allocated":31109120,"data_stored":61563209,"data_compressed":3170983,"data_compressed_allocated":30711808,"data_compressed_original":61423616,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116136,"kb_used_data":40736,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94255704,"statfs":{"total":96636764160,"available":96517840896,"internally_reserved":0,"allocated":41713664,"data_stored":83239785,"data_compressed":4289516,"data_compressed_allocated":41295872,"data_compressed_original":83083264,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41541632,"data_stored":83083264,"data_compressed":4289159,"data_compressed_allocated":41541632,"data_compressed_original":83083264,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30883840,"data_stored":61767680,"data_compressed":3188749,"data_compressed_allocated":30883840,"data_compressed_original":61767680,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":44199936,"data_stored":88399872,"data_compressed":4563610,"data_compressed_allocated":44199936,"data_compressed_original":88399872,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35028992,"data_stored":70057984,"data_compressed":3616724,"data_compressed_allocated":35028992,"data_compressed_original":70057984,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:33:06.429 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 15 12948 12933 1.12255 0.984375 0.158103 0.11123 2024-04-25T09:33:07.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1591 2024-04-25T09:33:07.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 12948 2024-04-25T09:33:07.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:33:07.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:33:07.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.12198 2024-04-25T09:33:07.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.100004 2024-04-25T09:33:07.430 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.30469 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.875 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 143 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 12.8005 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 167 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 112 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.111289 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.0573851 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.424563 2024-04-25T09:33:07.431 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0146734 2024-04-25T09:33:07.454 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:33:07.950 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:08.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:08.117+0000 7f99790ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:08.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:08.125+0000 7f99790ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:10.517 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:10.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:10.672+0000 7fbb85020640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:10.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:10.680+0000 7fbb85020640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:11.370 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:11.371 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:11.371 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:33:11.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:11.536+0000 7fee827cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:11.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:11.546+0000 7fee827cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:11.811 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:33:11.811 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:33:11.831 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-04-25T09:33:11.294080+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":106586656,"num_objects":1620,"num_object_clones":0,"num_object_copies":4860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":13076,"num_write_kb":105406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13020,"ondisk_log_size":13020,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":449896,"kb_used_data":156608,"kb_used_omap":0,"kb_used_meta":293248,"kb_avail":377037464,"statfs":{"total":386547056640,"available":386086363136,"internally_reserved":0,"allocated":160366592,"data_stored":319515524,"data_compressed":16464705,"data_compressed_allocated":158715904,"data_compressed_original":318906368,"omap_allocated":0,"internal_metadata":300285952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10362880,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":10120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002613"},"pg_stats":[{"pgid":"5.f","version":"47'959","reported_seq":1006,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:05.671614+0000","last_change":"2024-04-25T09:31:35.546963+0000","last_active":"2024-04-25T09:33:05.671614+0000","last_peered":"2024-04-25T09:33:05.671614+0000","last_clean":"2024-04-25T09:33:05.671614+0000","last_became_active":"2024-04-25T09:31:35.540156+0000","last_became_peered":"2024-04-25T09:31:35.540156+0000","last_unstale":"2024-04-25T09:33:05.671614+0000","last_undegraded":"2024-04-25T09:33:05.671614+0000","last_fullsized":"2024-04-25T09:33:05.671614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":960,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"47'679","reported_seq":722,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.140986+0000","last_change":"2024-04-25T09:31:35.553915+0000","last_active":"2024-04-25T09:33:06.140986+0000","last_peered":"2024-04-25T09:33:06.140986+0000","last_clean":"2024-04-25T09:33:06.140986+0000","last_became_active":"2024-04-25T09:31:35.548327+0000","last_became_peered":"2024-04-25T09:31:35.548327+0000","last_unstale":"2024-04-25T09:33:06.140986+0000","last_undegraded":"2024-04-25T09:33:06.140986+0000","last_fullsized":"2024-04-25T09:33:06.140986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"47'799","reported_seq":842,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.038496+0000","last_change":"2024-04-25T09:31:35.533889+0000","last_active":"2024-04-25T09:33:06.038496+0000","last_peered":"2024-04-25T09:33:06.038496+0000","last_clean":"2024-04-25T09:33:06.038496+0000","last_became_active":"2024-04-25T09:31:35.529477+0000","last_became_peered":"2024-04-25T09:31:35.529477+0000","last_unstale":"2024-04-25T09:33:06.038496+0000","last_undegraded":"2024-04-25T09:33:06.038496+0000","last_fullsized":"2024-04-25T09:33:06.038496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"47'655","reported_seq":700,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.294051+0000","last_change":"2024-04-25T09:31:35.524923+0000","last_active":"2024-04-25T09:33:06.294051+0000","last_peered":"2024-04-25T09:33:06.294051+0000","last_clean":"2024-04-25T09:33:06.294051+0000","last_became_active":"2024-04-25T09:31:35.516612+0000","last_became_peered":"2024-04-25T09:31:35.516612+0000","last_unstale":"2024-04-25T09:33:06.294051+0000","last_undegraded":"2024-04-25T09:33:06.294051+0000","last_fullsized":"2024-04-25T09:33:06.294051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"47'823","reported_seq":866,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.402831+0000","last_change":"2024-04-25T09:31:35.583698+0000","last_active":"2024-04-25T09:33:06.402831+0000","last_peered":"2024-04-25T09:33:06.402831+0000","last_clean":"2024-04-25T09:33:06.402831+0000","last_became_active":"2024-04-25T09:31:35.579242+0000","last_became_peered":"2024-04-25T09:31:35.579242+0000","last_unstale":"2024-04-25T09:33:06.402831+0000","last_undegraded":"2024-04-25T09:33:06.402831+0000","last_fullsized":"2024-04-25T09:33:06.402831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"47'807","reported_seq":854,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:05.996741+0000","last_change":"2024-04-25T09:31:35.507673+0000","last_active":"2024-04-25T09:33:05.996741+0000","last_peered":"2024-04-25T09:33:05.996741+0000","last_clean":"2024-04-25T09:33:05.996741+0000","last_became_active":"2024-04-25T09:31:35.493551+0000","last_became_peered":"2024-04-25T09:31:35.493551+0000","last_unstale":"2024-04-25T09:33:05.996741+0000","last_undegraded":"2024-04-25T09:33:05.996741+0000","last_fullsized":"2024-04-25T09:33:05.996741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"47'759","reported_seq":802,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:04.899818+0000","last_change":"2024-04-25T09:31:35.512556+0000","last_active":"2024-04-25T09:33:04.899818+0000","last_peered":"2024-04-25T09:33:04.899818+0000","last_clean":"2024-04-25T09:33:04.899818+0000","last_became_active":"2024-04-25T09:31:35.502633+0000","last_became_peered":"2024-04-25T09:31:35.502633+0000","last_unstale":"2024-04-25T09:33:04.899818+0000","last_undegraded":"2024-04-25T09:33:04.899818+0000","last_fullsized":"2024-04-25T09:33:04.899818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"47'831","reported_seq":874,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:05.912276+0000","last_change":"2024-04-25T09:31:35.558748+0000","last_active":"2024-04-25T09:33:05.912276+0000","last_peered":"2024-04-25T09:33:05.912276+0000","last_clean":"2024-04-25T09:33:05.912276+0000","last_became_active":"2024-04-25T09:31:35.549160+0000","last_became_peered":"2024-04-25T09:31:35.549160+0000","last_unstale":"2024-04-25T09:33:05.912276+0000","last_undegraded":"2024-04-25T09:33:05.912276+0000","last_fullsized":"2024-04-25T09:33:05.912276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":831,"log_dups_size":0,"ondisk_log_size":831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"47'823","reported_seq":870,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:04.638662+0000","last_change":"2024-04-25T09:31:35.528070+0000","last_active":"2024-04-25T09:33:04.638662+0000","last_peered":"2024-04-25T09:33:04.638662+0000","last_clean":"2024-04-25T09:33:04.638662+0000","last_became_active":"2024-04-25T09:31:35.513689+0000","last_became_peered":"2024-04-25T09:31:35.513689+0000","last_unstale":"2024-04-25T09:33:04.638662+0000","last_undegraded":"2024-04-25T09:33:04.638662+0000","last_fullsized":"2024-04-25T09:33:04.638662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":231,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.375795+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:32:48.375795+0000","last_peered":"2024-04-25T09:32:48.375795+0000","last_clean":"2024-04-25T09:32:48.375795+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:32:48.375795+0000","last_undegraded":"2024-04-25T09:32:48.375795+0000","last_fullsized":"2024-04-25T09:32:48.375795+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.603043+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:50.603043+0000","last_peered":"2024-04-25T09:32:50.603043+0000","last_clean":"2024-04-25T09:32:50.603043+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:50.603043+0000","last_undegraded":"2024-04-25T09:32:50.603043+0000","last_fullsized":"2024-04-25T09:32:50.603043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"47'742","reported_seq":785,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.423592+0000","last_change":"2024-04-25T09:31:35.540933+0000","last_active":"2024-04-25T09:33:06.423592+0000","last_peered":"2024-04-25T09:33:06.423592+0000","last_clean":"2024-04-25T09:33:06.423592+0000","last_became_active":"2024-04-25T09:31:35.524739+0000","last_became_peered":"2024-04-25T09:31:35.524739+0000","last_unstale":"2024-04-25T09:33:06.423592+0000","last_undegraded":"2024-04-25T09:33:06.423592+0000","last_fullsized":"2024-04-25T09:33:06.423592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6086656,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":743,"num_write_kb":5944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.580697+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:48.580697+0000","last_peered":"2024-04-25T09:32:48.580697+0000","last_clean":"2024-04-25T09:32:48.580697+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:48.580697+0000","last_undegraded":"2024-04-25T09:32:48.580697+0000","last_fullsized":"2024-04-25T09:32:48.580697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"47'895","reported_seq":942,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:04.700231+0000","last_change":"2024-04-25T09:31:35.596516+0000","last_active":"2024-04-25T09:33:04.700231+0000","last_peered":"2024-04-25T09:33:04.700231+0000","last_clean":"2024-04-25T09:33:04.700231+0000","last_became_active":"2024-04-25T09:31:35.591667+0000","last_became_peered":"2024-04-25T09:31:35.591667+0000","last_unstale":"2024-04-25T09:33:04.700231+0000","last_undegraded":"2024-04-25T09:33:04.700231+0000","last_fullsized":"2024-04-25T09:33:04.700231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":895,"log_dups_size":0,"ondisk_log_size":895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.589023+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:50.589023+0000","last_peered":"2024-04-25T09:32:50.589023+0000","last_clean":"2024-04-25T09:32:50.589023+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:50.589023+0000","last_undegraded":"2024-04-25T09:32:50.589023+0000","last_fullsized":"2024-04-25T09:32:50.589023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"47'787","reported_seq":834,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.449043+0000","last_change":"2024-04-25T09:31:35.578223+0000","last_active":"2024-04-25T09:33:06.449043+0000","last_peered":"2024-04-25T09:33:06.449043+0000","last_clean":"2024-04-25T09:33:06.449043+0000","last_became_active":"2024-04-25T09:31:35.556685+0000","last_became_peered":"2024-04-25T09:31:35.556685+0000","last_unstale":"2024-04-25T09:33:06.449043+0000","last_undegraded":"2024-04-25T09:33:06.449043+0000","last_fullsized":"2024-04-25T09:33:06.449043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455296,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":6304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.571482+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:48.571482+0000","last_peered":"2024-04-25T09:32:48.571482+0000","last_clean":"2024-04-25T09:32:48.571482+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:48.571482+0000","last_undegraded":"2024-04-25T09:32:48.571482+0000","last_fullsized":"2024-04-25T09:32:48.571482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"47'855","reported_seq":902,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.159052+0000","last_change":"2024-04-25T09:31:35.521077+0000","last_active":"2024-04-25T09:33:06.159052+0000","last_peered":"2024-04-25T09:33:06.159052+0000","last_clean":"2024-04-25T09:33:06.159052+0000","last_became_active":"2024-04-25T09:31:35.502951+0000","last_became_peered":"2024-04-25T09:31:35.502951+0000","last_unstale":"2024-04-25T09:33:06.159052+0000","last_undegraded":"2024-04-25T09:33:06.159052+0000","last_fullsized":"2024-04-25T09:33:06.159052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.538583+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:32:48.538583+0000","last_peered":"2024-04-25T09:32:48.538583+0000","last_clean":"2024-04-25T09:32:48.538583+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:32:48.538583+0000","last_undegraded":"2024-04-25T09:32:48.538583+0000","last_fullsized":"2024-04-25T09:32:48.538583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"47'871","reported_seq":914,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:06.275725+0000","last_change":"2024-04-25T09:31:35.528885+0000","last_active":"2024-04-25T09:33:06.275725+0000","last_peered":"2024-04-25T09:33:06.275725+0000","last_clean":"2024-04-25T09:33:06.275725+0000","last_became_active":"2024-04-25T09:31:35.524491+0000","last_became_peered":"2024-04-25T09:31:35.524491+0000","last_unstale":"2024-04-25T09:33:06.275725+0000","last_undegraded":"2024-04-25T09:33:06.275725+0000","last_fullsized":"2024-04-25T09:33:06.275725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.393265+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:32:48.393265+0000","last_peered":"2024-04-25T09:32:48.393265+0000","last_clean":"2024-04-25T09:32:48.393265+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:32:48.393265+0000","last_undegraded":"2024-04-25T09:32:48.393265+0000","last_fullsized":"2024-04-25T09:32:48.393265+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"47'799","reported_seq":844,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:04.819155+0000","last_change":"2024-04-25T09:31:35.535860+0000","last_active":"2024-04-25T09:33:04.819155+0000","last_peered":"2024-04-25T09:33:04.819155+0000","last_clean":"2024-04-25T09:33:04.819155+0000","last_became_active":"2024-04-25T09:31:35.529721+0000","last_became_peered":"2024-04-25T09:31:35.529721+0000","last_unstale":"2024-04-25T09:33:04.819155+0000","last_undegraded":"2024-04-25T09:33:04.819155+0000","last_fullsized":"2024-04-25T09:33:04.819155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.539690+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:32:48.539690+0000","last_peered":"2024-04-25T09:32:48.539690+0000","last_clean":"2024-04-25T09:32:48.539690+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:32:48.539690+0000","last_undegraded":"2024-04-25T09:32:48.539690+0000","last_fullsized":"2024-04-25T09:32:48.539690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"47'839","reported_seq":882,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:33:05.348954+0000","last_change":"2024-04-25T09:31:35.617662+0000","last_active":"2024-04-25T09:33:05.348954+0000","last_peered":"2024-04-25T09:33:05.348954+0000","last_clean":"2024-04-25T09:33:05.348954+0000","last_became_active":"2024-04-25T09:31:35.613054+0000","last_became_peered":"2024-04-25T09:31:35.613054+0000","last_unstale":"2024-04-25T09:33:05.348954+0000","last_undegraded":"2024-04-25T09:33:05.348954+0000","last_fullsized":"2024-04-25T09:33:05.348954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:31:34.337447+0000","last_clean_scrub_stamp":"2024-04-25T09:31:34.337447+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.614671+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:50.614671+0000","last_peered":"2024-04-25T09:32:50.614671+0000","last_clean":"2024-04-25T09:32:50.614671+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:50.614671+0000","last_undegraded":"2024-04-25T09:32:50.614671+0000","last_fullsized":"2024-04-25T09:32:50.614671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":105996288,"num_objects":1618,"num_object_clones":0,"num_object_copies":4854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12939,"num_write_kb":103512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159019008,"data_stored":318038016,"data_compressed":16418796,"data_compressed_allocated":159019008,"data_compressed_original":318038016,"omap_allocated":0,"internal_metadata":0},"log_size":12923,"ondisk_log_size":12923,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103288,"kb_used_data":36208,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94268552,"statfs":{"total":96636764160,"available":96530997248,"internally_reserved":0,"allocated":37076992,"data_stored":73966441,"data_compressed":3810815,"data_compressed_allocated":36659200,"data_compressed_original":73809920,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120856,"kb_used_data":45456,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94250984,"statfs":{"total":96636764160,"available":96513007616,"internally_reserved":0,"allocated":46546944,"data_stored":92906345,"data_compressed":4788580,"data_compressed_allocated":46129152,"data_compressed_original":92749824,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107556,"kb_used_data":32152,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94264284,"statfs":{"total":96636764160,"available":96526626816,"internally_reserved":0,"allocated":32923648,"data_stored":65192265,"data_compressed":3358372,"data_compressed_allocated":32526336,"data_compressed_original":65052672,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118196,"kb_used_data":42792,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94253644,"statfs":{"total":96636764160,"available":96515731456,"internally_reserved":0,"allocated":43819008,"data_stored":87450473,"data_compressed":4506938,"data_compressed_allocated":43401216,"data_compressed_original":87293952,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43577344,"data_stored":87154688,"data_compressed":4499390,"data_compressed_allocated":43577344,"data_compressed_original":87154688,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32735232,"data_stored":65470464,"data_compressed":3379945,"data_compressed_allocated":32735232,"data_compressed_original":65470464,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46088192,"data_stored":92176384,"data_compressed":4758613,"data_compressed_allocated":46088192,"data_compressed_original":92176384,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36618240,"data_stored":73236480,"data_compressed":3780848,"data_compressed_allocated":36618240,"data_compressed_original":73236480,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:33:13.236 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:13.376 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:13.389+0000 7f278079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:13.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:13.398+0000 7f278079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:15.766 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:15.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:15.910+0000 7fd1bf86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:15.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:15.921+0000 7fd1bf86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:16.832 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:16.832 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:16.833 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:33:16.833 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:33:16.872 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1619 objects 2024-04-25T09:33:16.872 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :9.41738 2024-04-25T09:33:16.949 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:16.959+0000 7f0d3b6ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:16.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:16.967+0000 7f0d3b6ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:16.972 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:16.972 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:16.973 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:33:17.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:17.130+0000 7faeafcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:17.124 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:17.139+0000 7faeafcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:17.140 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:17.140 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:17.140 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:17.140 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:17.140 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:17.141 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:17.141 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:17.141 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:17.141 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:17.141 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:17.141 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:17.141 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:17.143 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:17.143 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:17.144 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:33:17.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:17.261+0000 7f3fee2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:17.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:17.270+0000 7f3fee2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:17.271 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:17.273 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:17.274 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:17.274 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:33:17.385 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:17.395+0000 7f60c9d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:17.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:17.404+0000 7f60c9d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:17.403 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:17.403 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:17.403 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:17.403 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:17.404 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:17.406 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:17.406 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:18.476 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:18.587 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:18.600+0000 7f6f254ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:18.590 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:18.606+0000 7f6f254ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:20.085 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-04-25T09:33:20.085 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-04-25T09:33:20.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:20.209+0000 7f6ce8554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:20.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:20.222+0000 7f6ce8554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:20.660 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_2' removed 2024-04-25T09:33:20.674 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:33:20.675 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:33:20.675 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-04-25T09:33:20.675 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-04-25T09:33:20.693 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:20.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:20.796+0000 7f8917d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:20.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:20.808+0000 7f8917d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:20.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:20.840+0000 7f583846d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:20.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:20.845+0000 7f583846d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:21.666 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_3' created 2024-04-25T09:33:21.683 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-04-25T09:33:21.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:21.847+0000 7f1674cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:21.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:21.865+0000 7f1674cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:22.407 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:22.407 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:22.408 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:33:22.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:22.528+0000 7fa83fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:22.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:22.536+0000 7fa83fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:22.668 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-04-25T09:33:22.721 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:33:22.721 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:33:22.740 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-04-25T09:33:22.686115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":54,"acting":54,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":278412,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":276608,"kb_avail":377208948,"statfs":{"total":386547056640,"available":386261962752,"internally_reserved":0,"allocated":1814528,"data_stored":2343094,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":283246592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53903384,"num_objects":-824,"num_object_clones":0,"num_object_copies":-2472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-13745,"num_write_kb":-103585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.391251"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.773401+0000","last_change":"2024-04-25T09:33:21.773401+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.773401+0000","last_undegraded":"2024-04-25T09:33:21.773401+0000","last_fullsized":"2024-04-25T09:33:21.773401+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:33:21.677244+0000","last_change":"2024-04-25T09:33:21.677244+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.677244+0000","last_undegraded":"2024-04-25T09:33:21.677244+0000","last_fullsized":"2024-04-25T09:33:21.677244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:33:21.677244+0000","last_change":"2024-04-25T09:33:21.677244+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.677244+0000","last_undegraded":"2024-04-25T09:33:21.677244+0000","last_fullsized":"2024-04-25T09:33:21.677244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.933350+0000","last_change":"2024-04-25T09:33:21.933350+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.933350+0000","last_undegraded":"2024-04-25T09:33:21.933350+0000","last_fullsized":"2024-04-25T09:33:21.933350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:33:21.677244+0000","last_change":"2024-04-25T09:33:21.677244+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.677244+0000","last_undegraded":"2024-04-25T09:33:21.677244+0000","last_fullsized":"2024-04-25T09:33:21.677244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.757777+0000","last_change":"2024-04-25T09:33:21.757777+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.757777+0000","last_undegraded":"2024-04-25T09:33:21.757777+0000","last_fullsized":"2024-04-25T09:33:21.757777+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.904041+0000","last_change":"2024-04-25T09:33:21.904041+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.904041+0000","last_undegraded":"2024-04-25T09:33:21.904041+0000","last_fullsized":"2024-04-25T09:33:21.904041+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:33:21.677244+0000","last_change":"2024-04-25T09:33:21.677244+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.677244+0000","last_undegraded":"2024-04-25T09:33:21.677244+0000","last_fullsized":"2024-04-25T09:33:21.677244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:33:21.677244+0000","last_change":"2024-04-25T09:33:21.677244+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.677244+0000","last_undegraded":"2024-04-25T09:33:21.677244+0000","last_fullsized":"2024-04-25T09:33:21.677244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:33:21.714411+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:21.714411+0000","last_peered":"2024-04-25T09:33:21.714411+0000","last_clean":"2024-04-25T09:33:21.714411+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:21.714411+0000","last_undegraded":"2024-04-25T09:33:21.714411+0000","last_fullsized":"2024-04-25T09:33:21.714411+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.603043+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:32:50.603043+0000","last_peered":"2024-04-25T09:32:50.603043+0000","last_clean":"2024-04-25T09:32:50.603043+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:32:50.603043+0000","last_undegraded":"2024-04-25T09:32:50.603043+0000","last_fullsized":"2024-04-25T09:32:50.603043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.807284+0000","last_change":"2024-04-25T09:33:21.807284+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.807284+0000","last_undegraded":"2024-04-25T09:33:21.807284+0000","last_fullsized":"2024-04-25T09:33:21.807284+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.580697+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:32:48.580697+0000","last_peered":"2024-04-25T09:32:48.580697+0000","last_clean":"2024-04-25T09:32:48.580697+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:32:48.580697+0000","last_undegraded":"2024-04-25T09:32:48.580697+0000","last_fullsized":"2024-04-25T09:32:48.580697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.743017+0000","last_change":"2024-04-25T09:33:21.743017+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.743017+0000","last_undegraded":"2024-04-25T09:33:21.743017+0000","last_fullsized":"2024-04-25T09:33:21.743017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.589023+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:32:50.589023+0000","last_peered":"2024-04-25T09:32:50.589023+0000","last_clean":"2024-04-25T09:32:50.589023+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:32:50.589023+0000","last_undegraded":"2024-04-25T09:32:50.589023+0000","last_fullsized":"2024-04-25T09:32:50.589023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.856946+0000","last_change":"2024-04-25T09:33:21.856946+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.856946+0000","last_undegraded":"2024-04-25T09:33:21.856946+0000","last_fullsized":"2024-04-25T09:33:21.856946+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:48.571482+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:32:48.571482+0000","last_peered":"2024-04-25T09:32:48.571482+0000","last_clean":"2024-04-25T09:32:48.571482+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:32:48.571482+0000","last_undegraded":"2024-04-25T09:32:48.571482+0000","last_fullsized":"2024-04-25T09:32:48.571482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.714130+0000","last_change":"2024-04-25T09:33:21.714130+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.714130+0000","last_undegraded":"2024-04-25T09:33:21.714130+0000","last_fullsized":"2024-04-25T09:33:21.714130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:33:21.706996+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:21.706996+0000","last_peered":"2024-04-25T09:33:21.706996+0000","last_clean":"2024-04-25T09:33:21.706996+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:21.706996+0000","last_undegraded":"2024-04-25T09:33:21.706996+0000","last_fullsized":"2024-04-25T09:33:21.706996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-04-25T09:33:21.726684+0000","last_change":"2024-04-25T09:33:21.726684+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.726684+0000","last_undegraded":"2024-04-25T09:33:21.726684+0000","last_fullsized":"2024-04-25T09:33:21.726684+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":102,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:33:21.765846+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:21.765846+0000","last_peered":"2024-04-25T09:33:21.765846+0000","last_clean":"2024-04-25T09:33:21.765846+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:21.765846+0000","last_undegraded":"2024-04-25T09:33:21.765846+0000","last_fullsized":"2024-04-25T09:33:21.765846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:33:21.677244+0000","last_change":"2024-04-25T09:33:21.677244+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.677244+0000","last_undegraded":"2024-04-25T09:33:21.677244+0000","last_fullsized":"2024-04-25T09:33:21.677244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":104,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-25T09:33:21.707761+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:21.707761+0000","last_peered":"2024-04-25T09:33:21.707761+0000","last_clean":"2024-04-25T09:33:21.707761+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:21.707761+0000","last_undegraded":"2024-04-25T09:33:21.707761+0000","last_fullsized":"2024-04-25T09:33:21.707761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:33:21.677244+0000","last_change":"2024-04-25T09:33:21.677244+0000","last_active":"2024-04-25T09:33:21.677244+0000","last_peered":"2024-04-25T09:33:21.677244+0000","last_clean":"2024-04-25T09:33:21.677244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:33:21.677244+0000","last_undegraded":"2024-04-25T09:33:21.677244+0000","last_fullsized":"2024-04-25T09:33:21.677244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-25T09:32:50.614671+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:32:50.614671+0000","last_peered":"2024-04-25T09:32:50.614671+0000","last_clean":"2024-04-25T09:32:50.614671+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:32:50.614671+0000","last_undegraded":"2024-04-25T09:32:50.614671+0000","last_fullsized":"2024-04-25T09:32:50.614671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":27,"acting":27,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673299,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71708,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94300132,"statfs":{"total":96636764160,"available":96563335168,"internally_reserved":0,"allocated":479232,"data_stored":736770,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673299,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63388,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94308452,"statfs":{"total":96636764160,"available":96571854848,"internally_reserved":0,"allocated":479232,"data_stored":736770,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79948,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94291892,"statfs":{"total":96636764160,"available":96554897408,"internally_reserved":0,"allocated":397312,"data_stored":139593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63368,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94308472,"statfs":{"total":96636764160,"available":96571875328,"internally_reserved":0,"allocated":458752,"data_stored":729961,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:33:22.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:23.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:23.053+0000 7f61f2f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:23.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:23.058+0000 7f61f2f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:23.691 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-04-25T09:33:23.693 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:33:23.694 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:33:23.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:33:23.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:33:23.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_43292 2024-04-25T09:33:23.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:33:23.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:33:24.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 166 150 1.1718 1.17188 0.101134 0.10058 2024-04-25T09:33:25.138 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:25.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:25.285+0000 7f509a06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:25.278 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:25.294+0000 7f509a06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:25.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 328 312 1.21866 1.26562 0.0937877 0.0992627 2024-04-25T09:33:26.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 487 471 1.22646 1.24219 0.0885205 0.0999147 2024-04-25T09:33:27.517 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:27.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:27.676+0000 7efcf6e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:27.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:27.683+0000 7efcf6e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:27.742 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:27.743 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:27.743 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:33:27.743 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:33:27.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 642 626 1.22255 1.21094 0.183989 0.100503 2024-04-25T09:33:27.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:27.909+0000 7f88ecc24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:27.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:27.920+0000 7f88ecc24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:27.953 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:27.953 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:27.953 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:27.954 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:27.957 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:27.958 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:27.958 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:33:28.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:28.148+0000 7f4456aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:28.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:28.159+0000 7f4456aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:28.173 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:28.174 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:28.176 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:28.177 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:28.177 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:33:28.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:28.318+0000 7f2258c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:28.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:28.334+0000 7f2258c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:28.348 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:28.349 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:28.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:28.352 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:28.352 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:33:28.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:28.501+0000 7f8d6555d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:28.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:28.512+0000 7f8d6555d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:28.534 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:28.534 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:28.534 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:28.534 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:28.535 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:28.538 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:28.539 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:28.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 793 777 1.21396 1.17969 0.127127 0.101814 2024-04-25T09:33:29.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 947 931 1.21213 1.20312 0.0664537 0.102054 2024-04-25T09:33:29.926 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:30.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:30.071+0000 7f2ec615d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:30.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:30.078+0000 7f2ec615d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:30.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 1101 1085 1.21084 1.20312 0.0531988 0.102316 2024-04-25T09:33:31.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1256 1240 1.21083 1.21094 0.0641577 0.10239 2024-04-25T09:33:32.326 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:32.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:32.472+0000 7f0fb675d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:32.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:32.481+0000 7f0fb675d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:32.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1415 1399 1.21431 1.24219 0.0658912 0.102249 2024-04-25T09:33:33.539 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:33.539 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:33.540 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:33:33.540 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:33:33.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:33.689+0000 7f156866d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:33.686 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:33.702+0000 7f156866d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:33.704 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:33.704 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:33.704 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:33.704 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:33.704 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:33.705 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:33.705 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:33.705 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:33.705 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:33.705 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:33.705 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:33.705 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:33.707 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:33.708 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:33.708 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:33:33.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 1556 1540 1.20302 1.10156 0.119414 0.103219 2024-04-25T09:33:33.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:33.876+0000 7ffb04c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:33.875 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:33.890+0000 7ffb04c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:33.912 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:33.912 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:33.913 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:33.916 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:33.917 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:33.917 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:33:34.063 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:34.072+0000 7f4add82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:34.068 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:34.083+0000 7f4add82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:34.086 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:34.086 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:34.086 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:34.087 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:34.090 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:34.091 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:34.091 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:33:34.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:34.233+0000 7ff8f46ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:34.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:34.244+0000 7ff8f46ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:34.261 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:34.261 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:34.261 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:34.261 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:34.262 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:34.262 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:34.262 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:34.262 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:34.262 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:34.263 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:34.263 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:34.263 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:34.265 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:34.266 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:34.664 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:34.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1703 1687 1.19805 1.14844 0.0682509 0.103817 2024-04-25T09:33:34.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:34.806+0000 7fdf2b79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:34.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:34.814+0000 7fdf2b79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:35.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1853 1837 1.19586 1.17188 0.06387 0.103949 2024-04-25T09:33:36.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 2009 1993 1.19761 1.21875 0.0321621 0.103841 2024-04-25T09:33:37.051 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:37.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:37.195+0000 7f8a2c86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:37.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:37.202+0000 7f8a2c86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:37.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 2142 2126 1.18628 1.03906 0.0370001 0.104924 2024-04-25T09:33:38.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2293 2277 1.18583 1.17969 0.129816 0.104892 2024-04-25T09:33:39.266 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:39.266 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:39.267 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:33:39.267 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:33:39.404 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:39.432 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.437+0000 7f1b9559d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.453+0000 7f1b9559d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.493 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:39.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:39.495 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:39.495 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:39.497 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:39.497 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:39.498 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:33:39.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.566+0000 7f2ce34ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.573+0000 7f2ce34ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.681 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.688+0000 7f04a80ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.684 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.700+0000 7f04a80ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.707 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:39.707 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:39.707 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:39.707 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:39.707 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:39.707 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:39.707 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:39.708 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:39.708 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:39.708 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:39.708 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:39.708 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:39.710 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:39.711 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:39.711 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:33:39.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2421 2405 1.17421 1 0.146435 0.105994 2024-04-25T09:33:39.905 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.914+0000 7fe20d26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.909 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:39.925+0000 7fe20d26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:39.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:39.958 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:39.961 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:39.962 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:39.962 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:33:40.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:40.105+0000 7fda29f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:40.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:40.116+0000 7fda29f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:40.124 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:40.124 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:40.124 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:40.124 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:40.124 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:40.124 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:40.124 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:40.125 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:40.125 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:40.125 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:40.125 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:40.125 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:40.128 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:40.128 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:40.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2572 2556 1.17453 1.17969 0.0822964 0.106028 2024-04-25T09:33:41.734 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:41.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2728 2712 1.17698 1.21875 0.113081 0.105816 2024-04-25T09:33:41.900 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:41.914+0000 7f285426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:41.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:41.923+0000 7f285426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:42.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 2871 2855 1.17383 1.11719 0.0682606 0.106168 2024-04-25T09:33:43.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:33:43.775150+0000 min lat: 0.0145835 max lat: 0.328396 avg lat: 0.106132 2024-04-25T09:33:43.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:33:43.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 3019 3003 1.17295 1.15625 0.146723 0.106132 2024-04-25T09:33:44.074 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:44.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:44.210+0000 7fa2c22ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:44.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:44.217+0000 7fa2c22ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:44.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 3150 3134 1.16582 1.02344 0.0614845 0.106984 2024-04-25T09:33:45.129 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:45.129 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:45.130 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:33:45.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:45.276+0000 7f45cdb1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:45.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:45.287+0000 7f45cdb1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:45.548 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:33:45.548 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:33:45.567 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-25T09:33:45.301729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23200288,"num_objects":348,"num_object_clones":0,"num_object_copies":1044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2897,"num_write_kb":23974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2841,"ondisk_log_size":2841,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":314324,"kb_used_data":33524,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377173036,"statfs":{"total":386547056640,"available":386225188864,"internally_reserved":0,"allocated":34328576,"data_stored":67200560,"data_compressed":3433347,"data_compressed_allocated":32530432,"data_compressed_original":66535424,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12091392,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1476,"num_write_kb":11808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"6.f","version":"51'167","reported_seq":180,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.953009+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:33:41.953009+0000","last_peered":"2024-04-25T09:33:41.953009+0000","last_clean":"2024-04-25T09:33:41.953009+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:33:41.953009+0000","last_undegraded":"2024-04-25T09:33:41.953009+0000","last_fullsized":"2024-04-25T09:33:41.953009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'183","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:40.931941+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:33:40.931941+0000","last_peered":"2024-04-25T09:33:40.931941+0000","last_clean":"2024-04-25T09:33:40.931941+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:33:40.931941+0000","last_undegraded":"2024-04-25T09:33:40.931941+0000","last_fullsized":"2024-04-25T09:33:40.931941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'154","reported_seq":167,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.404932+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:33:41.404932+0000","last_peered":"2024-04-25T09:33:41.404932+0000","last_clean":"2024-04-25T09:33:41.404932+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:33:41.404932+0000","last_undegraded":"2024-04-25T09:33:41.404932+0000","last_fullsized":"2024-04-25T09:33:41.404932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269760,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'151","reported_seq":164,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:42.404240+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:33:42.404240+0000","last_peered":"2024-04-25T09:33:42.404240+0000","last_clean":"2024-04-25T09:33:42.404240+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:33:42.404240+0000","last_undegraded":"2024-04-25T09:33:42.404240+0000","last_fullsized":"2024-04-25T09:33:42.404240+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'116","reported_seq":129,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.414193+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:33:41.414193+0000","last_peered":"2024-04-25T09:33:41.414193+0000","last_clean":"2024-04-25T09:33:41.414193+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:33:41.414193+0000","last_undegraded":"2024-04-25T09:33:41.414193+0000","last_fullsized":"2024-04-25T09:33:41.414193+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":958464,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'215","reported_seq":228,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:42.114207+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:33:42.114207+0000","last_peered":"2024-04-25T09:33:42.114207+0000","last_clean":"2024-04-25T09:33:42.114207+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:33:42.114207+0000","last_undegraded":"2024-04-25T09:33:42.114207+0000","last_fullsized":"2024-04-25T09:33:42.114207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'143","reported_seq":156,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.976662+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:33:41.976662+0000","last_peered":"2024-04-25T09:33:41.976662+0000","last_clean":"2024-04-25T09:33:41.976662+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:33:41.976662+0000","last_undegraded":"2024-04-25T09:33:41.976662+0000","last_fullsized":"2024-04-25T09:33:41.976662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'103","reported_seq":116,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:38.653699+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:33:38.653699+0000","last_peered":"2024-04-25T09:33:38.653699+0000","last_clean":"2024-04-25T09:33:38.653699+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:33:38.653699+0000","last_undegraded":"2024-04-25T09:33:38.653699+0000","last_fullsized":"2024-04-25T09:33:38.653699+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'199","reported_seq":212,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.334744+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:33:41.334744+0000","last_peered":"2024-04-25T09:33:41.334744+0000","last_clean":"2024-04-25T09:33:41.334744+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:33:41.334744+0000","last_undegraded":"2024-04-25T09:33:41.334744+0000","last_fullsized":"2024-04-25T09:33:41.334744+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'231","reported_seq":244,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.682733+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:33:41.682733+0000","last_peered":"2024-04-25T09:33:41.682733+0000","last_clean":"2024-04-25T09:33:41.682733+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:33:41.682733+0000","last_undegraded":"2024-04-25T09:33:41.682733+0000","last_fullsized":"2024-04-25T09:33:41.682733+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'191","reported_seq":204,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.284724+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:33:41.284724+0000","last_peered":"2024-04-25T09:33:41.284724+0000","last_clean":"2024-04-25T09:33:41.284724+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:33:41.284724+0000","last_undegraded":"2024-04-25T09:33:41.284724+0000","last_fullsized":"2024-04-25T09:33:41.284724+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'135","reported_seq":148,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:42.285070+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:33:42.285070+0000","last_peered":"2024-04-25T09:33:42.285070+0000","last_clean":"2024-04-25T09:33:42.285070+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:33:42.285070+0000","last_undegraded":"2024-04-25T09:33:42.285070+0000","last_fullsized":"2024-04-25T09:33:42.285070+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'183","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:42.305923+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:33:42.305923+0000","last_peered":"2024-04-25T09:33:42.305923+0000","last_clean":"2024-04-25T09:33:42.305923+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:33:42.305923+0000","last_undegraded":"2024-04-25T09:33:42.305923+0000","last_fullsized":"2024-04-25T09:33:42.305923+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'199","reported_seq":212,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.852924+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:33:41.852924+0000","last_peered":"2024-04-25T09:33:41.852924+0000","last_clean":"2024-04-25T09:33:41.852924+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:33:41.852924+0000","last_undegraded":"2024-04-25T09:33:41.852924+0000","last_fullsized":"2024-04-25T09:33:41.852924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'191","reported_seq":204,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.015821+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:33:41.015821+0000","last_peered":"2024-04-25T09:33:41.015821+0000","last_clean":"2024-04-25T09:33:41.015821+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:33:41.015821+0000","last_undegraded":"2024-04-25T09:33:41.015821+0000","last_fullsized":"2024-04-25T09:33:41.015821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'183","reported_seq":196,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:41.427738+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:33:41.427738+0000","last_peered":"2024-04-25T09:33:41.427738+0000","last_clean":"2024-04-25T09:33:41.427738+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:33:41.427738+0000","last_undegraded":"2024-04-25T09:33:41.427738+0000","last_fullsized":"2024-04-25T09:33:41.427738+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":22609920,"num_objects":346,"num_object_clones":0,"num_object_copies":1038,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2760,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33595392,"data_stored":67190784,"data_compressed":3466116,"data_compressed_allocated":33595392,"data_compressed_original":67190784,"omap_allocated":0,"internal_metadata":0},"log_size":2744,"ondisk_log_size":2744,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70516,"kb_used_data":7596,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94301324,"statfs":{"total":96636764160,"available":96564555776,"internally_reserved":0,"allocated":7778304,"data_stored":15309332,"data_compressed":781351,"data_compressed_allocated":7323648,"data_compressed_original":15138816,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78996,"kb_used_data":7756,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94292844,"statfs":{"total":96636764160,"available":96555872256,"internally_reserved":0,"allocated":7942144,"data_stored":15637012,"data_compressed":798185,"data_compressed_allocated":7487488,"data_compressed_original":15466496,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80116,"kb_used_data":8876,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94291724,"statfs":{"total":96636764160,"available":96554725376,"internally_reserved":0,"allocated":9089024,"data_stored":17463284,"data_compressed":892941,"data_compressed_allocated":8654848,"data_compressed_original":17309696,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84696,"kb_used_data":9296,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94287144,"statfs":{"total":96636764160,"available":96550035456,"internally_reserved":0,"allocated":9519104,"data_stored":18790932,"data_compressed":960870,"data_compressed_allocated":9064448,"data_compressed_original":18620416,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9351168,"data_stored":18702336,"data_compressed":964743,"data_compressed_allocated":9351168,"data_compressed_original":18702336,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8978432,"data_stored":17956864,"data_compressed":926358,"data_compressed_allocated":8978432,"data_compressed_original":17956864,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7794688,"data_stored":15589376,"data_compressed":804173,"data_compressed_allocated":7794688,"data_compressed_original":15589376,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7471104,"data_stored":14942208,"data_compressed":770842,"data_compressed_allocated":7471104,"data_compressed_original":14942208,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:33:45.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 3296 3280 1.16467 1.14062 0.107635 0.107088 2024-04-25T09:33:46.389 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:46.517 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:46.530+0000 7fb31486d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:46.521 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:46.537+0000 7fb31486d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:46.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3447 3431 1.16532 1.17969 0.179915 0.106921 2024-04-25T09:33:47.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3592 3576 1.16396 1.13281 0.0285074 0.107088 2024-04-25T09:33:48.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:48.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 3739 3723 1.16334 1.14844 0.19321 0.107178 2024-04-25T09:33:48.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:48.901+0000 7f9e12ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:48.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:48.907+0000 7f9e12ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:49.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 3891 3875 1.16426 1.1875 0.0472395 0.107134 2024-04-25T09:33:50.569 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:50.569 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:50.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:33:50.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:50.707+0000 7fb2b0f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:50.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:50.718+0000 7fb2b0f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:50.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 4038 4022 1.16367 1.14844 0.0711527 0.107137 2024-04-25T09:33:50.947 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:33:50.947 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:33:50.964 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-04-25T09:33:49.302462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29147680,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":3623,"num_write_kb":29782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3567,"ondisk_log_size":3567,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":327316,"kb_used_data":42356,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377160044,"statfs":{"total":386547056640,"available":386211885056,"internally_reserved":0,"allocated":43372544,"data_stored":85288496,"data_compressed":4367331,"data_compressed_allocated":41574400,"data_compressed_original":84623360,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15810560,"num_objects":242,"num_object_clones":0,"num_object_copies":726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1930,"num_write_kb":15440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002332"},"pg_stats":[{"pgid":"6.f","version":"51'191","reported_seq":204,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:44.667451+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:33:44.667451+0000","last_peered":"2024-04-25T09:33:44.667451+0000","last_clean":"2024-04-25T09:33:44.667451+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:33:44.667451+0000","last_undegraded":"2024-04-25T09:33:44.667451+0000","last_fullsized":"2024-04-25T09:33:44.667451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'223","reported_seq":236,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:45.945800+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:33:45.945800+0000","last_peered":"2024-04-25T09:33:45.945800+0000","last_clean":"2024-04-25T09:33:45.945800+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:33:45.945800+0000","last_undegraded":"2024-04-25T09:33:45.945800+0000","last_fullsized":"2024-04-25T09:33:45.945800+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'210","reported_seq":223,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.421894+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:33:46.421894+0000","last_peered":"2024-04-25T09:33:46.421894+0000","last_clean":"2024-04-25T09:33:46.421894+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:33:46.421894+0000","last_undegraded":"2024-04-25T09:33:46.421894+0000","last_fullsized":"2024-04-25T09:33:46.421894+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728512,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":1688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'223","reported_seq":236,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:47.347264+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:33:47.347264+0000","last_peered":"2024-04-25T09:33:47.347264+0000","last_clean":"2024-04-25T09:33:47.347264+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:33:47.347264+0000","last_undegraded":"2024-04-25T09:33:47.347264+0000","last_fullsized":"2024-04-25T09:33:47.347264+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'151","reported_seq":164,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.157115+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:33:46.157115+0000","last_peered":"2024-04-25T09:33:46.157115+0000","last_clean":"2024-04-25T09:33:46.157115+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:33:46.157115+0000","last_undegraded":"2024-04-25T09:33:46.157115+0000","last_fullsized":"2024-04-25T09:33:46.157115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'239","reported_seq":252,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:47.393496+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:33:47.393496+0000","last_peered":"2024-04-25T09:33:47.393496+0000","last_clean":"2024-04-25T09:33:47.393496+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:33:47.393496+0000","last_undegraded":"2024-04-25T09:33:47.393496+0000","last_fullsized":"2024-04-25T09:33:47.393496+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'175","reported_seq":188,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.204320+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:33:46.204320+0000","last_peered":"2024-04-25T09:33:46.204320+0000","last_clean":"2024-04-25T09:33:46.204320+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:33:46.204320+0000","last_undegraded":"2024-04-25T09:33:46.204320+0000","last_fullsized":"2024-04-25T09:33:46.204320+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'141","reported_seq":154,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.437197+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:33:46.437197+0000","last_peered":"2024-04-25T09:33:46.437197+0000","last_clean":"2024-04-25T09:33:46.437197+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:33:46.437197+0000","last_undegraded":"2024-04-25T09:33:46.437197+0000","last_fullsized":"2024-04-25T09:33:46.437197+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163264,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'215","reported_seq":228,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.328103+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:33:46.328103+0000","last_peered":"2024-04-25T09:33:46.328103+0000","last_clean":"2024-04-25T09:33:46.328103+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:33:46.328103+0000","last_undegraded":"2024-04-25T09:33:46.328103+0000","last_fullsized":"2024-04-25T09:33:46.328103+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'247","reported_seq":260,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.442754+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:33:46.442754+0000","last_peered":"2024-04-25T09:33:46.442754+0000","last_clean":"2024-04-25T09:33:46.442754+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:33:46.442754+0000","last_undegraded":"2024-04-25T09:33:46.442754+0000","last_fullsized":"2024-04-25T09:33:46.442754+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'259","reported_seq":272,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:47.429777+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:33:47.429777+0000","last_peered":"2024-04-25T09:33:47.429777+0000","last_clean":"2024-04-25T09:33:47.429777+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:33:47.429777+0000","last_undegraded":"2024-04-25T09:33:47.429777+0000","last_fullsized":"2024-04-25T09:33:47.429777+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129920,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":260,"num_write_kb":2080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'200","reported_seq":213,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.483347+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:33:46.483347+0000","last_peered":"2024-04-25T09:33:46.483347+0000","last_clean":"2024-04-25T09:33:46.483347+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:33:46.483347+0000","last_undegraded":"2024-04-25T09:33:46.483347+0000","last_fullsized":"2024-04-25T09:33:46.483347+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1646592,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":1608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'215","reported_seq":228,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:47.288252+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:33:47.288252+0000","last_peered":"2024-04-25T09:33:47.288252+0000","last_clean":"2024-04-25T09:33:47.288252+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:33:47.288252+0000","last_undegraded":"2024-04-25T09:33:47.288252+0000","last_fullsized":"2024-04-25T09:33:47.288252+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'271","reported_seq":284,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:46.286448+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:33:46.286448+0000","last_peered":"2024-04-25T09:33:46.286448+0000","last_clean":"2024-04-25T09:33:46.286448+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:33:46.286448+0000","last_undegraded":"2024-04-25T09:33:46.286448+0000","last_fullsized":"2024-04-25T09:33:46.286448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'279","reported_seq":292,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:45.512356+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:33:45.512356+0000","last_peered":"2024-04-25T09:33:45.512356+0000","last_clean":"2024-04-25T09:33:45.512356+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:33:45.512356+0000","last_undegraded":"2024-04-25T09:33:45.512356+0000","last_fullsized":"2024-04-25T09:33:45.512356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'231","reported_seq":244,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:45.155204+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:33:45.155204+0000","last_peered":"2024-04-25T09:33:45.155204+0000","last_clean":"2024-04-25T09:33:45.155204+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:33:45.155204+0000","last_undegraded":"2024-04-25T09:33:45.155204+0000","last_fullsized":"2024-04-25T09:33:45.155204+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":28557312,"num_objects":438,"num_object_clones":0,"num_object_copies":1314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3486,"num_write_kb":27888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":42622976,"data_stored":85245952,"data_compressed":4398408,"data_compressed_allocated":42622976,"data_compressed_original":85245952,"omap_allocated":0,"internal_metadata":0},"log_size":3470,"ondisk_log_size":3470,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76552,"kb_used_data":9472,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94295288,"statfs":{"total":96636764160,"available":96558374912,"internally_reserved":0,"allocated":9699328,"data_stored":19151380,"data_compressed":979738,"data_compressed_allocated":9244672,"data_compressed_original":18980864,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81016,"kb_used_data":9776,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94290824,"statfs":{"total":96636764160,"available":96553803776,"internally_reserved":0,"allocated":10010624,"data_stored":19773972,"data_compressed":1011800,"data_compressed_allocated":9555968,"data_compressed_original":19603456,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82656,"kb_used_data":11416,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94289184,"statfs":{"total":96636764160,"available":96552124416,"internally_reserved":0,"allocated":11689984,"data_stored":22665204,"data_compressed":1161546,"data_compressed_allocated":11255808,"data_compressed_original":22511616,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87092,"kb_used_data":11692,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94284748,"statfs":{"total":96636764160,"available":96547581952,"internally_reserved":0,"allocated":11972608,"data_stored":23697940,"data_compressed":1214247,"data_compressed_allocated":11517952,"data_compressed_original":23527424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11726848,"data_stored":23453696,"data_compressed":1210083,"data_compressed_allocated":11726848,"data_compressed_original":23453696,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11563008,"data_stored":23126016,"data_compressed":1193271,"data_compressed_allocated":11563008,"data_compressed_original":23126016,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9863168,"data_stored":19726336,"data_compressed":1017788,"data_compressed_allocated":9863168,"data_compressed_original":19726336,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9469952,"data_stored":18939904,"data_compressed":977266,"data_compressed_allocated":9469952,"data_compressed_original":18939904,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:33:51.064 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:51.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:51.194+0000 7f99a042d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:51.186 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:51.201+0000 7f99a042d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:51.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 4190 4174 1.16452 1.1875 0.109207 0.107122 2024-04-25T09:33:52.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 4345 4329 1.16612 1.21094 0.0442059 0.107005 2024-04-25T09:33:53.378 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:53.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:53.522+0000 7fa0f842d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:53.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:53.530+0000 7fa0f842d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:53.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4484 4468 1.16344 1.08594 0.185523 0.107075 2024-04-25T09:33:54.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4626 4610 1.16169 1.10938 0.142048 0.107299 2024-04-25T09:33:55.664 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:33:55.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 4763 4747 1.15883 1.07031 0.138374 0.107613 2024-04-25T09:33:55.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:55.803+0000 7fb930ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:55.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:55.810+0000 7fb930ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:55.967 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:33:55.967 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:33:55.967 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:33:55.967 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:33:56.099 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.109+0000 7f66d126d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.120+0000 7f66d126d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.125 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:56.125 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:56.125 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:56.125 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:56.125 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:56.125 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:56.126 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:56.126 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:56.126 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:56.126 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:56.126 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:56.126 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:56.129 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:56.130 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:56.130 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:33:56.261 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.271+0000 7f1fb9c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.281+0000 7f1fb9c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.328 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:56.328 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:56.328 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:56.328 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:56.328 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:56.328 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:56.328 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:56.329 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:56.329 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:56.329 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:56.329 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:56.329 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:56.331 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:56.331 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:56.332 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:33:56.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.464+0000 7fae43a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.474+0000 7fae43a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:56.475 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:56.476 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:56.476 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:56.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:56.478 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:56.478 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:33:56.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.612+0000 7fae5bc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.607 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:56.623+0000 7fae5bc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:56.635 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:33:56.635 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:33:56.635 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:33:56.635 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:33:56.635 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:33:56.635 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:33:56.636 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:33:56.636 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:33:56.636 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:33:56.636 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:33:56.636 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:33:56.636 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:33:56.638 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:33:56.639 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:33:56.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 4890 4874 1.15378 0.992188 0.164162 0.108123 2024-04-25T09:33:57.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 5031 5015 1.15224 1.10156 0.200256 0.108164 2024-04-25T09:33:58.049 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:33:58.187 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:58.201+0000 7fab4ae2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:58.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:33:58.207+0000 7fab4ae2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:33:58.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 5177 5161 1.15191 1.14062 0.0384422 0.108277 2024-04-25T09:33:59.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 5331 5315 1.15333 1.20312 0.0479038 0.108211 2024-04-25T09:34:00.407 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:00.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:00.542+0000 7f6617e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:00.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:00.549+0000 7f6617e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:00.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5480 5464 1.15362 1.16406 0.0435185 0.108145 2024-04-25T09:34:01.640 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:01.640 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:01.641 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:01.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5626 5610 1.15327 1.14062 0.134104 0.108151 2024-04-25T09:34:01.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:01.809+0000 7f6f4439d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:01.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:01.820+0000 7f6f4439d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:02.120 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:02.138 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-04-25T09:34:01.304857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40837664,"num_objects":617,"num_object_clones":0,"num_object_copies":1851,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5050,"num_write_kb":41198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4994,"ondisk_log_size":4994,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":344716,"kb_used_data":59756,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377142644,"statfs":{"total":386547056640,"available":386194067456,"internally_reserved":0,"allocated":61190144,"data_stored":120923696,"data_compressed":6207381,"data_compressed_allocated":59392000,"data_compressed_original":120258560,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11689984,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1427,"num_write_kb":11416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002394"},"pg_stats":[{"pgid":"6.f","version":"51'265","reported_seq":278,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:57.421985+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:33:57.421985+0000","last_peered":"2024-04-25T09:33:57.421985+0000","last_clean":"2024-04-25T09:33:57.421985+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:33:57.421985+0000","last_undegraded":"2024-04-25T09:33:57.421985+0000","last_fullsized":"2024-04-25T09:33:57.421985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179072,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":2128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'319","reported_seq":332,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:56.355243+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:33:56.355243+0000","last_peered":"2024-04-25T09:33:56.355243+0000","last_clean":"2024-04-25T09:33:56.355243+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:33:56.355243+0000","last_undegraded":"2024-04-25T09:33:56.355243+0000","last_fullsized":"2024-04-25T09:33:56.355243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'295","reported_seq":308,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:56.101270+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:33:56.101270+0000","last_peered":"2024-04-25T09:33:56.101270+0000","last_clean":"2024-04-25T09:33:56.101270+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:33:56.101270+0000","last_undegraded":"2024-04-25T09:33:56.101270+0000","last_fullsized":"2024-04-25T09:33:56.101270+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'351","reported_seq":364,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:57.228449+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:33:57.228449+0000","last_peered":"2024-04-25T09:33:57.228449+0000","last_clean":"2024-04-25T09:33:57.228449+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:33:57.228449+0000","last_undegraded":"2024-04-25T09:33:57.228449+0000","last_fullsized":"2024-04-25T09:33:57.228449+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'231","reported_seq":244,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:56.436383+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:33:56.436383+0000","last_peered":"2024-04-25T09:33:56.436383+0000","last_clean":"2024-04-25T09:33:56.436383+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:33:56.436383+0000","last_undegraded":"2024-04-25T09:33:56.436383+0000","last_fullsized":"2024-04-25T09:33:56.436383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'295","reported_seq":308,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:55.678703+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:33:55.678703+0000","last_peered":"2024-04-25T09:33:55.678703+0000","last_clean":"2024-04-25T09:33:55.678703+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:33:55.678703+0000","last_undegraded":"2024-04-25T09:33:55.678703+0000","last_fullsized":"2024-04-25T09:33:55.678703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'231","reported_seq":244,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:56.258082+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:33:56.258082+0000","last_peered":"2024-04-25T09:33:56.258082+0000","last_clean":"2024-04-25T09:33:56.258082+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:33:56.258082+0000","last_undegraded":"2024-04-25T09:33:56.258082+0000","last_fullsized":"2024-04-25T09:33:56.258082+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'271","reported_seq":284,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:55.981341+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:33:55.981341+0000","last_peered":"2024-04-25T09:33:55.981341+0000","last_clean":"2024-04-25T09:33:55.981341+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:33:55.981341+0000","last_undegraded":"2024-04-25T09:33:55.981341+0000","last_fullsized":"2024-04-25T09:33:55.981341+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'287","reported_seq":300,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:53.524868+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:33:53.524868+0000","last_peered":"2024-04-25T09:33:53.524868+0000","last_clean":"2024-04-25T09:33:53.524868+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:33:53.524868+0000","last_undegraded":"2024-04-25T09:33:53.524868+0000","last_fullsized":"2024-04-25T09:33:53.524868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'327","reported_seq":340,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:57.091561+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:33:57.091561+0000","last_peered":"2024-04-25T09:33:57.091561+0000","last_clean":"2024-04-25T09:33:57.091561+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:33:57.091561+0000","last_undegraded":"2024-04-25T09:33:57.091561+0000","last_fullsized":"2024-04-25T09:33:57.091561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'383","reported_seq":396,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:55.095883+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:33:55.095883+0000","last_peered":"2024-04-25T09:33:55.095883+0000","last_clean":"2024-04-25T09:33:55.095883+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:33:55.095883+0000","last_undegraded":"2024-04-25T09:33:55.095883+0000","last_fullsized":"2024-04-25T09:33:55.095883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'263","reported_seq":276,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:56.132110+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:33:56.132110+0000","last_peered":"2024-04-25T09:33:56.132110+0000","last_clean":"2024-04-25T09:33:56.132110+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:33:56.132110+0000","last_undegraded":"2024-04-25T09:33:56.132110+0000","last_fullsized":"2024-04-25T09:33:56.132110+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'279","reported_seq":292,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:57.101105+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:33:57.101105+0000","last_peered":"2024-04-25T09:33:57.101105+0000","last_clean":"2024-04-25T09:33:57.101105+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:33:57.101105+0000","last_undegraded":"2024-04-25T09:33:57.101105+0000","last_fullsized":"2024-04-25T09:33:57.101105+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'382","reported_seq":395,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:57.433372+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:33:57.433372+0000","last_peered":"2024-04-25T09:33:57.433372+0000","last_clean":"2024-04-25T09:33:57.433372+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:33:57.433372+0000","last_undegraded":"2024-04-25T09:33:57.433372+0000","last_fullsized":"2024-04-25T09:33:57.433372+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3137536,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'391","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:56.244512+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:33:56.244512+0000","last_peered":"2024-04-25T09:33:56.244512+0000","last_clean":"2024-04-25T09:33:56.244512+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:33:56.244512+0000","last_undegraded":"2024-04-25T09:33:56.244512+0000","last_fullsized":"2024-04-25T09:33:56.244512+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'327","reported_seq":340,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:55.259259+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:33:55.259259+0000","last_peered":"2024-04-25T09:33:55.259259+0000","last_clean":"2024-04-25T09:33:55.259259+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:33:55.259259+0000","last_undegraded":"2024-04-25T09:33:55.259259+0000","last_fullsized":"2024-04-25T09:33:55.259259+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":40247296,"num_objects":615,"num_object_clones":0,"num_object_copies":1845,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4913,"num_write_kb":39304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":60207104,"data_stored":120414208,"data_compressed":6214347,"data_compressed_allocated":60207104,"data_compressed_original":120414208,"omap_allocated":0,"internal_metadata":0},"log_size":4897,"ondisk_log_size":4897,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84708,"kb_used_data":13468,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94287132,"statfs":{"total":96636764160,"available":96550023168,"internally_reserved":0,"allocated":13791232,"data_stored":27335188,"data_compressed":1402315,"data_compressed_allocated":13336576,"data_compressed_original":27164672,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673334,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89420,"kb_used_data":14020,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94282420,"statfs":{"total":96636764160,"available":96545198080,"internally_reserved":0,"allocated":14356480,"data_stored":28465684,"data_compressed":1460603,"data_compressed_allocated":13901824,"data_compressed_original":28295168,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91180,"kb_used_data":15780,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94280660,"statfs":{"total":96636764160,"available":96543395840,"internally_reserved":0,"allocated":16158720,"data_stored":31602676,"data_compressed":1623039,"data_compressed_allocated":15724544,"data_compressed_original":31449088,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79408,"kb_used_data":16488,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94292432,"statfs":{"total":96636764160,"available":96555450368,"internally_reserved":0,"allocated":16883712,"data_stored":33520148,"data_compressed":1721424,"data_compressed_allocated":16429056,"data_compressed_original":33349632,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16580608,"data_stored":33161216,"data_compressed":1711338,"data_compressed_allocated":16580608,"data_compressed_original":33161216,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16015360,"data_stored":32030720,"data_compressed":1653072,"data_compressed_allocated":16015360,"data_compressed_original":32030720,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":28065792,"data_compressed":1448402,"data_compressed_allocated":14032896,"data_compressed_original":28065792,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13578240,"data_stored":27156480,"data_compressed":1401535,"data_compressed_allocated":13578240,"data_compressed_original":27156480,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:02.756 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:02.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 5761 5745 1.15074 1.05469 0.135255 0.108461 2024-04-25T09:34:02.911 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:02.924+0000 7f5d1e224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:02.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:02.931+0000 7f5d1e224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:03.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:34:03.776935+0000 min lat: 0.0145835 max lat: 0.328396 avg lat: 0.108625 2024-04-25T09:34:03.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:34:03.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 5895 5879 1.14814 1.04688 0.155075 0.108625 2024-04-25T09:34:04.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 6022 6006 1.14434 0.992188 0.250175 0.10892 2024-04-25T09:34:05.121 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:05.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:05.289+0000 7effe746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:05.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:05.297+0000 7effe746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:05.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 6154 6138 1.14164 1.03125 0.104287 0.109314 2024-04-25T09:34:06.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 6298 6282 1.14125 1.125 0.115395 0.109366 2024-04-25T09:34:07.140 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:07.140 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:07.140 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:07.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:07.285+0000 7f3f84bee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:07.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:07.297+0000 7f3f84bee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:07.466 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:07.498 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:07.499 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:07.512 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-04-25T09:34:07.306162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":48898592,"num_objects":741,"num_object_clones":0,"num_object_copies":2223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6034,"num_write_kb":49070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5978,"ondisk_log_size":5978,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":345228,"kb_used_data":72744,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377142132,"statfs":{"total":386547056640,"available":386193543168,"internally_reserved":0,"allocated":74489856,"data_stored":147523120,"data_compressed":7580862,"data_compressed_allocated":72691712,"data_compressed_original":146857984,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13877248,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":13552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002493"},"pg_stats":[{"pgid":"6.f","version":"51'351","reported_seq":364,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:02.088719+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:34:02.088719+0000","last_peered":"2024-04-25T09:34:02.088719+0000","last_clean":"2024-04-25T09:34:02.088719+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:34:02.088719+0000","last_undegraded":"2024-04-25T09:34:02.088719+0000","last_fullsized":"2024-04-25T09:34:02.088719+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'414","reported_seq":427,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.428268+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:34:06.428268+0000","last_peered":"2024-04-25T09:34:06.428268+0000","last_clean":"2024-04-25T09:34:06.428268+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:34:06.428268+0000","last_undegraded":"2024-04-25T09:34:06.428268+0000","last_fullsized":"2024-04-25T09:34:06.428268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3399680,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'391","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.936679+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:34:05.936679+0000","last_peered":"2024-04-25T09:34:05.936679+0000","last_clean":"2024-04-25T09:34:05.936679+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:34:05.936679+0000","last_undegraded":"2024-04-25T09:34:05.936679+0000","last_fullsized":"2024-04-25T09:34:05.936679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'428","reported_seq":441,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:02.416794+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:34:02.416794+0000","last_peered":"2024-04-25T09:34:02.416794+0000","last_clean":"2024-04-25T09:34:02.416794+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:34:02.416794+0000","last_undegraded":"2024-04-25T09:34:02.416794+0000","last_fullsized":"2024-04-25T09:34:02.416794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3514368,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":3432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'287","reported_seq":300,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.433354+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:34:05.433354+0000","last_peered":"2024-04-25T09:34:05.433354+0000","last_clean":"2024-04-25T09:34:05.433354+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:34:05.433354+0000","last_undegraded":"2024-04-25T09:34:05.433354+0000","last_fullsized":"2024-04-25T09:34:05.433354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'335","reported_seq":348,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:02.164574+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:34:02.164574+0000","last_peered":"2024-04-25T09:34:02.164574+0000","last_clean":"2024-04-25T09:34:02.164574+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:34:02.164574+0000","last_undegraded":"2024-04-25T09:34:02.164574+0000","last_fullsized":"2024-04-25T09:34:02.164574+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'255","reported_seq":268,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:02.310857+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:34:02.310857+0000","last_peered":"2024-04-25T09:34:02.310857+0000","last_clean":"2024-04-25T09:34:02.310857+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:34:02.310857+0000","last_undegraded":"2024-04-25T09:34:02.310857+0000","last_fullsized":"2024-04-25T09:34:02.310857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'383","reported_seq":396,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.275294+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:34:06.275294+0000","last_peered":"2024-04-25T09:34:06.275294+0000","last_clean":"2024-04-25T09:34:06.275294+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:34:06.275294+0000","last_undegraded":"2024-04-25T09:34:06.275294+0000","last_fullsized":"2024-04-25T09:34:06.275294+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'327","reported_seq":340,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.406862+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:34:05.406862+0000","last_peered":"2024-04-25T09:34:05.406862+0000","last_clean":"2024-04-25T09:34:05.406862+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:34:05.406862+0000","last_undegraded":"2024-04-25T09:34:05.406862+0000","last_fullsized":"2024-04-25T09:34:05.406862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'361","reported_seq":374,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:02.425834+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:34:02.425834+0000","last_peered":"2024-04-25T09:34:02.425834+0000","last_clean":"2024-04-25T09:34:02.425834+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:34:02.425834+0000","last_undegraded":"2024-04-25T09:34:02.425834+0000","last_fullsized":"2024-04-25T09:34:02.425834+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2965504,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":362,"num_write_kb":2896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'415","reported_seq":428,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:01.022674+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:34:01.022674+0000","last_peered":"2024-04-25T09:34:01.022674+0000","last_clean":"2024-04-25T09:34:01.022674+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:34:01.022674+0000","last_undegraded":"2024-04-25T09:34:01.022674+0000","last_fullsized":"2024-04-25T09:34:01.022674+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'311","reported_seq":324,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:02.391286+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:34:02.391286+0000","last_peered":"2024-04-25T09:34:02.391286+0000","last_clean":"2024-04-25T09:34:02.391286+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:34:02.391286+0000","last_undegraded":"2024-04-25T09:34:02.391286+0000","last_fullsized":"2024-04-25T09:34:02.391286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'330","reported_seq":343,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:02.432592+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:34:02.432592+0000","last_peered":"2024-04-25T09:34:02.432592+0000","last_clean":"2024-04-25T09:34:02.432592+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:34:02.432592+0000","last_undegraded":"2024-04-25T09:34:02.432592+0000","last_fullsized":"2024-04-25T09:34:02.432592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2711552,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'431","reported_seq":444,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:01.677476+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:34:01.677476+0000","last_peered":"2024-04-25T09:34:01.677476+0000","last_clean":"2024-04-25T09:34:01.677476+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:34:01.677476+0000","last_undegraded":"2024-04-25T09:34:01.677476+0000","last_fullsized":"2024-04-25T09:34:01.677476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'471","reported_seq":484,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:04.820002+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:34:04.820002+0000","last_peered":"2024-04-25T09:34:04.820002+0000","last_clean":"2024-04-25T09:34:04.820002+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:34:04.820002+0000","last_undegraded":"2024-04-25T09:34:04.820002+0000","last_fullsized":"2024-04-25T09:34:04.820002+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'391","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.910931+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:34:05.910931+0000","last_peered":"2024-04-25T09:34:05.910931+0000","last_clean":"2024-04-25T09:34:05.910931+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:34:05.910931+0000","last_undegraded":"2024-04-25T09:34:05.910931+0000","last_fullsized":"2024-04-25T09:34:05.910931+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":48308224,"num_objects":739,"num_object_clones":0,"num_object_copies":2217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5897,"num_write_kb":47176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73441280,"data_stored":146882560,"data_compressed":7581060,"data_compressed_allocated":73441280,"data_compressed_original":146882560,"omap_allocated":0,"internal_metadata":0},"log_size":5881,"ondisk_log_size":5881,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86612,"kb_used_data":15368,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94285228,"statfs":{"total":96636764160,"available":96548073472,"internally_reserved":0,"allocated":15736832,"data_stored":31226388,"data_compressed":1603240,"data_compressed_allocated":15282176,"data_compressed_original":31055872,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673339,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79080,"kb_used_data":16160,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94292760,"statfs":{"total":96636764160,"available":96555786240,"internally_reserved":0,"allocated":16547840,"data_stored":32848404,"data_compressed":1686908,"data_compressed_allocated":16093184,"data_compressed_original":32677888,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87288,"kb_used_data":20208,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94284552,"statfs":{"total":96636764160,"available":96547381248,"internally_reserved":0,"allocated":20692992,"data_stored":40671220,"data_compressed":2091300,"data_compressed_allocated":20258816,"data_compressed_original":40517632,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92248,"kb_used_data":21008,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94279592,"statfs":{"total":96636764160,"available":96542302208,"internally_reserved":0,"allocated":21512192,"data_stored":42777108,"data_compressed":2199414,"data_compressed_allocated":21057536,"data_compressed_original":42606592,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21217280,"data_stored":42434560,"data_compressed":2190174,"data_compressed_allocated":21217280,"data_compressed_original":42434560,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20533248,"data_stored":41066496,"data_compressed":2119641,"data_compressed_allocated":20533248,"data_compressed_original":41066496,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16281600,"data_stored":32563200,"data_compressed":1680629,"data_compressed_allocated":16281600,"data_compressed_original":32563200,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15409152,"data_stored":30818304,"data_compressed":1590616,"data_compressed_allocated":15409152,"data_compressed_original":30818304,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:07.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:07.624+0000 7f25cd954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:07.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:07.632+0000 7f25cd954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:07.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 6433 6417 1.13928 1.05469 0.125867 0.109546 2024-04-25T09:34:08.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 6572 6556 1.13809 1.08594 0.0991874 0.109536 2024-04-25T09:34:09.760 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:09.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 6718 6702 1.13815 1.14062 0.0988017 0.10966 2024-04-25T09:34:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:09.905+0000 7f150906d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:09.897 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:09.912+0000 7f150906d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:10.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 6850 6834 1.13587 1.03125 0.0973218 0.109897 2024-04-25T09:34:11.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 6986 6970 1.13434 1.0625 0.0918675 0.110069 2024-04-25T09:34:12.084 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:12.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:12.230+0000 7ff02986d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:12.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:12.238+0000 7ff02986d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:12.514 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:12.514 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:12.514 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:12.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:12.661+0000 7f017142d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:12.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:12.671+0000 7f017142d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:12.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 7118 7102 1.13223 1.03125 0.0462382 0.110175 2024-04-25T09:34:12.859 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:12.860 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:12.872 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-04-25T09:34:11.307089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":52396576,"num_objects":793,"num_object_clones":0,"num_object_copies":2379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6461,"num_write_kb":52486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6405,"ondisk_log_size":6405,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":353212,"kb_used_data":76572,"kb_used_omap":0,"kb_used_meta":276608,"kb_avail":377134148,"statfs":{"total":386547056640,"available":386185367552,"internally_reserved":0,"allocated":78409728,"data_stored":155362864,"data_compressed":7985673,"data_compressed_allocated":76611584,"data_compressed_original":154697728,"omap_allocated":0,"internal_metadata":283246592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11558912,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1411,"num_write_kb":11288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002645"},"pg_stats":[{"pgid":"6.f","version":"51'407","reported_seq":420,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.535086+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:34:06.535086+0000","last_peered":"2024-04-25T09:34:06.535086+0000","last_clean":"2024-04-25T09:34:06.535086+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:34:06.535086+0000","last_undegraded":"2024-04-25T09:34:06.535086+0000","last_fullsized":"2024-04-25T09:34:06.535086+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'414","reported_seq":427,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.428268+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:34:06.428268+0000","last_peered":"2024-04-25T09:34:06.428268+0000","last_clean":"2024-04-25T09:34:06.428268+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:34:06.428268+0000","last_undegraded":"2024-04-25T09:34:06.428268+0000","last_fullsized":"2024-04-25T09:34:06.428268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3399680,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'391","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.936679+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:34:05.936679+0000","last_peered":"2024-04-25T09:34:05.936679+0000","last_clean":"2024-04-25T09:34:05.936679+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:34:05.936679+0000","last_undegraded":"2024-04-25T09:34:05.936679+0000","last_fullsized":"2024-04-25T09:34:05.936679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'479","reported_seq":492,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:07.324648+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:34:07.324648+0000","last_peered":"2024-04-25T09:34:07.324648+0000","last_clean":"2024-04-25T09:34:07.324648+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:34:07.324648+0000","last_undegraded":"2024-04-25T09:34:07.324648+0000","last_fullsized":"2024-04-25T09:34:07.324648+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'287","reported_seq":300,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.433354+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:34:05.433354+0000","last_peered":"2024-04-25T09:34:05.433354+0000","last_clean":"2024-04-25T09:34:05.433354+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:34:05.433354+0000","last_undegraded":"2024-04-25T09:34:05.433354+0000","last_fullsized":"2024-04-25T09:34:05.433354+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'359","reported_seq":372,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:07.323409+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:34:07.323409+0000","last_peered":"2024-04-25T09:34:07.323409+0000","last_clean":"2024-04-25T09:34:07.323409+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:34:07.323409+0000","last_undegraded":"2024-04-25T09:34:07.323409+0000","last_fullsized":"2024-04-25T09:34:07.323409+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'308","reported_seq":321,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:07.431305+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:34:07.431305+0000","last_peered":"2024-04-25T09:34:07.431305+0000","last_clean":"2024-04-25T09:34:07.431305+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:34:07.431305+0000","last_undegraded":"2024-04-25T09:34:07.431305+0000","last_fullsized":"2024-04-25T09:34:07.431305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2531328,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":2472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'383","reported_seq":396,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.275294+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:34:06.275294+0000","last_peered":"2024-04-25T09:34:06.275294+0000","last_clean":"2024-04-25T09:34:06.275294+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:34:06.275294+0000","last_undegraded":"2024-04-25T09:34:06.275294+0000","last_fullsized":"2024-04-25T09:34:06.275294+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'327","reported_seq":340,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.406862+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:34:05.406862+0000","last_peered":"2024-04-25T09:34:05.406862+0000","last_clean":"2024-04-25T09:34:05.406862+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:34:05.406862+0000","last_undegraded":"2024-04-25T09:34:05.406862+0000","last_fullsized":"2024-04-25T09:34:05.406862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'399","reported_seq":412,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.268760+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:34:05.268760+0000","last_peered":"2024-04-25T09:34:05.268760+0000","last_clean":"2024-04-25T09:34:05.268760+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:34:05.268760+0000","last_undegraded":"2024-04-25T09:34:05.268760+0000","last_fullsized":"2024-04-25T09:34:05.268760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'487","reported_seq":500,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.711129+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:34:06.711129+0000","last_peered":"2024-04-25T09:34:06.711129+0000","last_clean":"2024-04-25T09:34:06.711129+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:34:06.711129+0000","last_undegraded":"2024-04-25T09:34:06.711129+0000","last_fullsized":"2024-04-25T09:34:06.711129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'343","reported_seq":356,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.658823+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:34:06.658823+0000","last_peered":"2024-04-25T09:34:06.658823+0000","last_clean":"2024-04-25T09:34:06.658823+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:34:06.658823+0000","last_undegraded":"2024-04-25T09:34:06.658823+0000","last_fullsized":"2024-04-25T09:34:06.658823+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'367","reported_seq":380,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:06.944116+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:34:06.944116+0000","last_peered":"2024-04-25T09:34:06.944116+0000","last_clean":"2024-04-25T09:34:06.944116+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:34:06.944116+0000","last_undegraded":"2024-04-25T09:34:06.944116+0000","last_fullsized":"2024-04-25T09:34:06.944116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'495","reported_seq":508,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:07.213369+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:34:07.213369+0000","last_peered":"2024-04-25T09:34:07.213369+0000","last_clean":"2024-04-25T09:34:07.213369+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:34:07.213369+0000","last_undegraded":"2024-04-25T09:34:07.213369+0000","last_fullsized":"2024-04-25T09:34:07.213369+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'471","reported_seq":484,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:04.820002+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:34:04.820002+0000","last_peered":"2024-04-25T09:34:04.820002+0000","last_clean":"2024-04-25T09:34:04.820002+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:34:04.820002+0000","last_undegraded":"2024-04-25T09:34:04.820002+0000","last_fullsized":"2024-04-25T09:34:04.820002+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'391","reported_seq":404,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:05.910931+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:34:05.910931+0000","last_peered":"2024-04-25T09:34:05.910931+0000","last_clean":"2024-04-25T09:34:05.910931+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:34:05.910931+0000","last_undegraded":"2024-04-25T09:34:05.910931+0000","last_fullsized":"2024-04-25T09:34:05.910931+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":51806208,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6324,"num_write_kb":50592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77467648,"data_stored":154935296,"data_compressed":7996869,"data_compressed_allocated":77467648,"data_compressed_original":154935296,"omap_allocated":0,"internal_metadata":0},"log_size":6308,"ondisk_log_size":6308,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673344,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92544,"kb_used_data":17144,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94279296,"statfs":{"total":96636764160,"available":96541999104,"internally_reserved":0,"allocated":17555456,"data_stored":34863636,"data_compressed":1791052,"data_compressed_allocated":17100800,"data_compressed_original":34693120,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673344,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81132,"kb_used_data":18212,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94290708,"statfs":{"total":96636764160,"available":96553684992,"internally_reserved":0,"allocated":18649088,"data_stored":37050900,"data_compressed":1903907,"data_compressed_allocated":18194432,"data_compressed_original":36880384,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87288,"kb_used_data":20208,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94284552,"statfs":{"total":96636764160,"available":96547381248,"internally_reserved":0,"allocated":20692992,"data_stored":40671220,"data_compressed":2091300,"data_compressed_allocated":20258816,"data_compressed_original":40517632,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706048,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92248,"kb_used_data":21008,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94279592,"statfs":{"total":96636764160,"available":96542302208,"internally_reserved":0,"allocated":21512192,"data_stored":42777108,"data_compressed":2199414,"data_compressed_allocated":21057536,"data_compressed_original":42606592,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21217280,"data_stored":42434560,"data_compressed":2190174,"data_compressed_allocated":21217280,"data_compressed_original":42434560,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20533248,"data_stored":41066496,"data_compressed":2119641,"data_compressed_allocated":20533248,"data_compressed_original":41066496,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18464768,"data_stored":36929536,"data_compressed":1906088,"data_compressed_allocated":18464768,"data_compressed_original":36929536,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17252352,"data_stored":34504704,"data_compressed":1780966,"data_compressed_allocated":17252352,"data_compressed_original":34504704,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:13.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 7236 7220 1.12803 0.921875 0.17425 0.110616 2024-04-25T09:34:14.497 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:14.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:14.658+0000 7fd0eed1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:14.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:14.665+0000 7fd0eed1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:14.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 7374 7358 1.12705 1.07812 0.0997734 0.110731 2024-04-25T09:34:15.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 7503 7487 1.12475 1.00781 0.182102 0.110901 2024-04-25T09:34:16.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 7645 7629 1.12446 1.10938 0.0194314 0.111037 2024-04-25T09:34:16.831 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:16.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:16.981+0000 7fca89cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:16.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:16.988+0000 7fca89cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:17.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 7776 7760 1.12259 1.02344 0.0661795 0.11124 2024-04-25T09:34:17.874 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:17.874 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:17.875 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:34:17.875 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:34:18.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.019+0000 7f456d217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.033+0000 7f456d217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.045 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:18.045 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:18.045 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:18.045 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:18.046 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:18.048 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:18.049 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:18.049 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:34:18.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.186+0000 7fa40ce6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.183 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.199+0000 7fa40ce6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:18.211 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:18.212 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:18.214 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:18.215 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:18.215 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:34:18.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.345+0000 7ff827c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.340 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.356+0000 7ff827c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.357 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:18.358 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:18.359 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:18.360 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:18.360 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:18.360 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:18.361 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:18.361 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:34:18.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.502+0000 7f78c299d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.509 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:18.513+0000 7f78c299d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:18.526 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:18.527 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:18.527 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:18.527 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:18.529 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:18.530 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:18.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 7888 7872 1.11808 0.875 0.0766262 0.111633 2024-04-25T09:34:19.131 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:19.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:19.263+0000 7f7bbf22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:19.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:19.269+0000 7f7bbf22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:19.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 8004 7988 1.1143 0.90625 0.0238901 0.111979 2024-04-25T09:34:20.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 8142 8126 1.11366 1.07812 0.0313554 0.112118 2024-04-25T09:34:21.388 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:21.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:21.535+0000 7f710d0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:21.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:21.542+0000 7f710d0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:21.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 8274 8258 1.11224 1.03125 0.151966 0.112261 2024-04-25T09:34:22.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 8410 8394 1.1114 1.0625 0.169677 0.112305 2024-04-25T09:34:23.530 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:23.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:23.531 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:23.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:23.675+0000 7f424539d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:23.670 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:23.686+0000 7f424539d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:23.681 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:23.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:34:23.778738+0000 min lat: 0.0145835 max lat: 0.423737 avg lat: 0.112376 2024-04-25T09:34:23.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:34:23.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 8550 8534 1.1111 1.09375 0.122592 0.112376 2024-04-25T09:34:23.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:23.825+0000 7fa1b3806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:23.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:23.831+0000 7fa1b3806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:24.023 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:24.024 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:24.042 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-25T09:34:23.309732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68436512,"num_objects":1038,"num_object_clones":0,"num_object_copies":3114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8419,"num_write_kb":68150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8363,"ondisk_log_size":8363,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":381036,"kb_used_data":100236,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377106324,"statfs":{"total":386547056640,"available":386156875776,"internally_reserved":0,"allocated":102641664,"data_stored":203826736,"data_compressed":10488141,"data_compressed_allocated":100843520,"data_compressed_original":203161600,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16039936,"num_objects":245,"num_object_clones":0,"num_object_copies":735,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1958,"num_write_kb":15664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002643"},"pg_stats":[{"pgid":"6.f","version":"51'503","reported_seq":516,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:22.078927+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:34:22.078927+0000","last_peered":"2024-04-25T09:34:22.078927+0000","last_clean":"2024-04-25T09:34:22.078927+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:34:22.078927+0000","last_undegraded":"2024-04-25T09:34:22.078927+0000","last_fullsized":"2024-04-25T09:34:22.078927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'527","reported_seq":540,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:18.885661+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:34:18.885661+0000","last_peered":"2024-04-25T09:34:18.885661+0000","last_clean":"2024-04-25T09:34:18.885661+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:34:18.885661+0000","last_undegraded":"2024-04-25T09:34:18.885661+0000","last_fullsized":"2024-04-25T09:34:18.885661+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'503","reported_seq":516,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:20.880972+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:34:20.880972+0000","last_peered":"2024-04-25T09:34:20.880972+0000","last_clean":"2024-04-25T09:34:20.880972+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:34:20.880972+0000","last_undegraded":"2024-04-25T09:34:20.880972+0000","last_fullsized":"2024-04-25T09:34:20.880972+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'687","reported_seq":700,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:22.348377+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:34:22.348377+0000","last_peered":"2024-04-25T09:34:22.348377+0000","last_clean":"2024-04-25T09:34:22.348377+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:34:22.348377+0000","last_undegraded":"2024-04-25T09:34:22.348377+0000","last_fullsized":"2024-04-25T09:34:22.348377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'422","reported_seq":435,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:21.423305+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:34:21.423305+0000","last_peered":"2024-04-25T09:34:21.423305+0000","last_clean":"2024-04-25T09:34:21.423305+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:34:21.423305+0000","last_undegraded":"2024-04-25T09:34:21.423305+0000","last_fullsized":"2024-04-25T09:34:21.423305+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3465216,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":423,"num_write_kb":3384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'487","reported_seq":500,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:21.243032+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:34:21.243032+0000","last_peered":"2024-04-25T09:34:21.243032+0000","last_clean":"2024-04-25T09:34:21.243032+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:34:21.243032+0000","last_undegraded":"2024-04-25T09:34:21.243032+0000","last_fullsized":"2024-04-25T09:34:21.243032+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'439","reported_seq":452,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:21.370252+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:34:21.370252+0000","last_peered":"2024-04-25T09:34:21.370252+0000","last_clean":"2024-04-25T09:34:21.370252+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:34:21.370252+0000","last_undegraded":"2024-04-25T09:34:21.370252+0000","last_fullsized":"2024-04-25T09:34:21.370252+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'479","reported_seq":492,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:20.722341+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:34:20.722341+0000","last_peered":"2024-04-25T09:34:20.722341+0000","last_clean":"2024-04-25T09:34:20.722341+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:34:20.722341+0000","last_undegraded":"2024-04-25T09:34:20.722341+0000","last_fullsized":"2024-04-25T09:34:20.722341+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'434","reported_seq":447,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:21.429639+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:34:21.429639+0000","last_peered":"2024-04-25T09:34:21.429639+0000","last_clean":"2024-04-25T09:34:21.429639+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:34:21.429639+0000","last_undegraded":"2024-04-25T09:34:21.429639+0000","last_fullsized":"2024-04-25T09:34:21.429639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563520,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'543","reported_seq":556,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:21.493809+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:34:21.493809+0000","last_peered":"2024-04-25T09:34:21.493809+0000","last_clean":"2024-04-25T09:34:21.493809+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:34:21.493809+0000","last_undegraded":"2024-04-25T09:34:21.493809+0000","last_fullsized":"2024-04-25T09:34:21.493809+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'543","reported_seq":556,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:16.708252+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:34:16.708252+0000","last_peered":"2024-04-25T09:34:16.708252+0000","last_clean":"2024-04-25T09:34:16.708252+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:34:16.708252+0000","last_undegraded":"2024-04-25T09:34:16.708252+0000","last_fullsized":"2024-04-25T09:34:16.708252+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'463","reported_seq":476,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:21.272580+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:34:21.272580+0000","last_peered":"2024-04-25T09:34:21.272580+0000","last_clean":"2024-04-25T09:34:21.272580+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:34:21.272580+0000","last_undegraded":"2024-04-25T09:34:21.272580+0000","last_fullsized":"2024-04-25T09:34:21.272580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'495","reported_seq":508,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:22.438695+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:34:22.438695+0000","last_peered":"2024-04-25T09:34:22.438695+0000","last_clean":"2024-04-25T09:34:22.438695+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:34:22.438695+0000","last_undegraded":"2024-04-25T09:34:22.438695+0000","last_fullsized":"2024-04-25T09:34:22.438695+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'599","reported_seq":612,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:22.178962+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:34:22.178962+0000","last_peered":"2024-04-25T09:34:22.178962+0000","last_clean":"2024-04-25T09:34:22.178962+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:34:22.178962+0000","last_undegraded":"2024-04-25T09:34:22.178962+0000","last_fullsized":"2024-04-25T09:34:22.178962+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'607","reported_seq":620,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:19.178763+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:34:19.178763+0000","last_peered":"2024-04-25T09:34:19.178763+0000","last_clean":"2024-04-25T09:34:19.178763+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:34:19.178763+0000","last_undegraded":"2024-04-25T09:34:19.178763+0000","last_fullsized":"2024-04-25T09:34:19.178763+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'535","reported_seq":548,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:20.204474+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:34:20.204474+0000","last_peered":"2024-04-25T09:34:20.204474+0000","last_clean":"2024-04-25T09:34:20.204474+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:34:20.204474+0000","last_undegraded":"2024-04-25T09:34:20.204474+0000","last_fullsized":"2024-04-25T09:34:20.204474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":67846144,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8282,"num_write_kb":66256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101715968,"data_stored":203431936,"data_compressed":10501029,"data_compressed_allocated":101715968,"data_compressed_original":203431936,"omap_allocated":0,"internal_metadata":0},"log_size":8266,"ondisk_log_size":8266,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85612,"kb_used_data":22692,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94286228,"statfs":{"total":96636764160,"available":96549097472,"internally_reserved":0,"allocated":23236608,"data_stored":46225940,"data_compressed":2377753,"data_compressed_allocated":22781952,"data_compressed_original":46055424,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673359,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94800,"kb_used_data":23560,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94277040,"statfs":{"total":96636764160,"available":96539688960,"internally_reserved":0,"allocated":24125440,"data_stored":48003604,"data_compressed":2469458,"data_compressed_allocated":23670784,"data_compressed_original":47833088,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98200,"kb_used_data":26960,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94273640,"statfs":{"total":96636764160,"available":96536207360,"internally_reserved":0,"allocated":27607040,"data_stored":54499316,"data_compressed":2805324,"data_compressed_allocated":27172864,"data_compressed_original":54345728,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102424,"kb_used_data":27024,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94269416,"statfs":{"total":96636764160,"available":96531881984,"internally_reserved":0,"allocated":27672576,"data_stored":55097876,"data_compressed":2835606,"data_compressed_allocated":27217920,"data_compressed_original":54927360,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27394048,"data_stored":54788096,"data_compressed":2828058,"data_compressed_allocated":27394048,"data_compressed_original":54788096,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27480064,"data_stored":54960128,"data_compressed":2837049,"data_compressed_allocated":27480064,"data_compressed_original":54960128,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23920640,"data_stored":47841280,"data_compressed":2469524,"data_compressed_allocated":23920640,"data_compressed_original":47841280,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22921216,"data_stored":45842432,"data_compressed":2366398,"data_compressed_allocated":22921216,"data_compressed_original":45842432,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:24.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 8676 8660 1.10902 0.984375 0.0592895 0.112614 2024-04-25T09:34:25.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 8823 8807 1.10965 1.14844 0.0250081 0.112556 2024-04-25T09:34:26.043 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:26.166 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:26.179+0000 7fec13a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:26.171 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:26.187+0000 7fec13a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:26.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 8960 8944 1.10903 1.07031 0.162619 0.112581 2024-04-25T09:34:27.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 9087 9071 1.1072 0.992188 0.0782686 0.112765 2024-04-25T09:34:28.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:28.455 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:28.468+0000 7f0790aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:28.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:28.476+0000 7f0790aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:28.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 9222 9206 1.10639 1.05469 0.0948967 0.112864 2024-04-25T09:34:29.044 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:29.045 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:29.045 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:34:29.045 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:34:29.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.219+0000 7fa2bbf5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.234+0000 7fa2bbf5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.282 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:29.282 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:29.282 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:29.282 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:29.283 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:29.286 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:29.287 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:29.287 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:34:29.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.425+0000 7f2d18b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.436+0000 7f2d18b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:29.482 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:29.483 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:29.483 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:29.483 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:29.485 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:29.486 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:29.486 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:34:29.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.642+0000 7fcd9f82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.655+0000 7fcd9f82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.706 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:29.706 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:29.706 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:29.706 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:29.707 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:29.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:29.710 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:29.710 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:34:29.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 9353 9337 1.10513 1.02344 0.128471 0.11299 2024-04-25T09:34:29.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.868+0000 7fe945c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:29.878+0000 7fe945c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:29.880 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:29.881 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:29.881 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:29.881 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:29.881 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:29.881 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:29.881 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:29.882 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:29.882 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:29.882 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:29.882 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:29.882 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:29.884 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:29.885 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:30.688 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:30.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 9476 9460 1.10298 0.960938 0.0639375 0.113153 2024-04-25T09:34:30.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:30.836+0000 7fa21439d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:30.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:30.843+0000 7fa21439d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:31.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 9604 9588 1.10146 1 0.128794 0.113379 2024-04-25T09:34:32.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 9735 9719 1.10033 1.02344 0.0361379 0.113469 2024-04-25T09:34:33.007 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:33.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:33.147+0000 7f085fc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:33.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:33.155+0000 7f085fc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:33.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 9858 9842 1.09834 0.960938 0.167341 0.113657 2024-04-25T09:34:34.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 9994 9978 1.09783 1.0625 0.14246 0.11374 2024-04-25T09:34:34.886 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:34.886 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:34.887 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:35.031 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:35.040+0000 7fabe6aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:35.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:35.051+0000 7fabe6aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:35.318 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:35.391 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:35.391 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:35.413 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-04-25T09:34:35.312660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79241760,"num_objects":1203,"num_object_clones":0,"num_object_copies":3609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9738,"num_write_kb":78702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9682,"ondisk_log_size":9682,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":392972,"kb_used_data":116332,"kb_used_omap":0,"kb_used_meta":276608,"kb_avail":377094388,"statfs":{"total":386547056640,"available":386144653312,"internally_reserved":0,"allocated":119123968,"data_stored":236791344,"data_compressed":12190293,"data_compressed_allocated":117325824,"data_compressed_original":236126208,"omap_allocated":0,"internal_metadata":283246592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10805248,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":10552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002927"},"pg_stats":[{"pgid":"6.f","version":"51'638","reported_seq":651,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:32.429482+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:34:32.429482+0000","last_peered":"2024-04-25T09:34:32.429482+0000","last_clean":"2024-04-25T09:34:32.429482+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:34:32.429482+0000","last_undegraded":"2024-04-25T09:34:32.429482+0000","last_fullsized":"2024-04-25T09:34:32.429482+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5234688,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":639,"num_write_kb":5112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'591","reported_seq":604,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:30.970483+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:34:30.970483+0000","last_peered":"2024-04-25T09:34:30.970483+0000","last_clean":"2024-04-25T09:34:30.970483+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:34:30.970483+0000","last_undegraded":"2024-04-25T09:34:30.970483+0000","last_fullsized":"2024-04-25T09:34:30.970483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'615","reported_seq":628,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:30.859016+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:34:30.859016+0000","last_peered":"2024-04-25T09:34:30.859016+0000","last_clean":"2024-04-25T09:34:30.859016+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:34:30.859016+0000","last_undegraded":"2024-04-25T09:34:30.859016+0000","last_fullsized":"2024-04-25T09:34:30.859016+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'727","reported_seq":740,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:29.695129+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:34:29.695129+0000","last_peered":"2024-04-25T09:34:29.695129+0000","last_clean":"2024-04-25T09:34:29.695129+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:34:29.695129+0000","last_undegraded":"2024-04-25T09:34:29.695129+0000","last_fullsized":"2024-04-25T09:34:29.695129+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'503","reported_seq":516,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:30.535211+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:34:30.535211+0000","last_peered":"2024-04-25T09:34:30.535211+0000","last_clean":"2024-04-25T09:34:30.535211+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:34:30.535211+0000","last_undegraded":"2024-04-25T09:34:30.535211+0000","last_fullsized":"2024-04-25T09:34:30.535211+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'591","reported_seq":604,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:32.202573+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:34:32.202573+0000","last_peered":"2024-04-25T09:34:32.202573+0000","last_clean":"2024-04-25T09:34:32.202573+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:34:32.202573+0000","last_undegraded":"2024-04-25T09:34:32.202573+0000","last_fullsized":"2024-04-25T09:34:32.202573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'527","reported_seq":540,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:32.343690+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:34:32.343690+0000","last_peered":"2024-04-25T09:34:32.343690+0000","last_clean":"2024-04-25T09:34:32.343690+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:34:32.343690+0000","last_undegraded":"2024-04-25T09:34:32.343690+0000","last_fullsized":"2024-04-25T09:34:32.343690+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'563","reported_seq":576,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:31.430350+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:34:31.430350+0000","last_peered":"2024-04-25T09:34:31.430350+0000","last_clean":"2024-04-25T09:34:31.430350+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:34:31.430350+0000","last_undegraded":"2024-04-25T09:34:31.430350+0000","last_fullsized":"2024-04-25T09:34:31.430350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4620288,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":564,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'487","reported_seq":500,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:31.441250+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:34:31.441250+0000","last_peered":"2024-04-25T09:34:31.441250+0000","last_clean":"2024-04-25T09:34:31.441250+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:34:31.441250+0000","last_undegraded":"2024-04-25T09:34:31.441250+0000","last_fullsized":"2024-04-25T09:34:31.441250+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'647","reported_seq":660,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:30.214227+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:34:30.214227+0000","last_peered":"2024-04-25T09:34:30.214227+0000","last_clean":"2024-04-25T09:34:30.214227+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:34:30.214227+0000","last_undegraded":"2024-04-25T09:34:30.214227+0000","last_fullsized":"2024-04-25T09:34:30.214227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'631","reported_seq":644,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:29.670358+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:34:29.670358+0000","last_peered":"2024-04-25T09:34:29.670358+0000","last_clean":"2024-04-25T09:34:29.670358+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:34:29.670358+0000","last_undegraded":"2024-04-25T09:34:29.670358+0000","last_fullsized":"2024-04-25T09:34:29.670358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'519","reported_seq":532,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:30.249677+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:34:30.249677+0000","last_peered":"2024-04-25T09:34:30.249677+0000","last_clean":"2024-04-25T09:34:30.249677+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:34:30.249677+0000","last_undegraded":"2024-04-25T09:34:30.249677+0000","last_fullsized":"2024-04-25T09:34:30.249677+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'551","reported_seq":564,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:30.075580+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:34:30.075580+0000","last_peered":"2024-04-25T09:34:30.075580+0000","last_clean":"2024-04-25T09:34:30.075580+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:34:30.075580+0000","last_undegraded":"2024-04-25T09:34:30.075580+0000","last_fullsized":"2024-04-25T09:34:30.075580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'687","reported_seq":700,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:32.289680+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:34:32.289680+0000","last_peered":"2024-04-25T09:34:32.289680+0000","last_clean":"2024-04-25T09:34:32.289680+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:34:32.289680+0000","last_undegraded":"2024-04-25T09:34:32.289680+0000","last_fullsized":"2024-04-25T09:34:32.289680+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'685","reported_seq":698,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:31.426908+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:34:31.426908+0000","last_peered":"2024-04-25T09:34:31.426908+0000","last_clean":"2024-04-25T09:34:31.426908+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:34:31.426908+0000","last_undegraded":"2024-04-25T09:34:31.426908+0000","last_fullsized":"2024-04-25T09:34:31.426908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5619712,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":5488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'623","reported_seq":636,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:30.760052+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:34:30.760052+0000","last_peered":"2024-04-25T09:34:30.760052+0000","last_clean":"2024-04-25T09:34:30.760052+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:34:30.760052+0000","last_undegraded":"2024-04-25T09:34:30.760052+0000","last_fullsized":"2024-04-25T09:34:30.760052+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":78651392,"num_objects":1201,"num_object_clones":0,"num_object_copies":3603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9601,"num_write_kb":76808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118075392,"data_stored":236150784,"data_compressed":12190491,"data_compressed_allocated":118075392,"data_compressed_original":236150784,"omap_allocated":0,"internal_metadata":0},"log_size":9585,"ondisk_log_size":9585,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93312,"kb_used_data":26232,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94278528,"statfs":{"total":96636764160,"available":96541212672,"internally_reserved":0,"allocated":26861568,"data_stored":53475860,"data_compressed":2752108,"data_compressed_allocated":26406912,"data_compressed_original":53305344,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98472,"kb_used_data":27232,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94273368,"statfs":{"total":96636764160,"available":96535928832,"internally_reserved":0,"allocated":27885568,"data_stored":55523860,"data_compressed":2857772,"data_compressed_allocated":27430912,"data_compressed_original":55353344,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106816,"kb_used_data":31416,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94265024,"statfs":{"total":96636764160,"available":96527384576,"internally_reserved":0,"allocated":32169984,"data_stored":63625204,"data_compressed":3276546,"data_compressed_allocated":31735808,"data_compressed_original":63471616,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94372,"kb_used_data":31452,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94277468,"statfs":{"total":96636764160,"available":96540127232,"internally_reserved":0,"allocated":32206848,"data_stored":64166420,"data_compressed":3303867,"data_compressed_allocated":31752192,"data_compressed_original":63995904,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31956992,"data_stored":63913984,"data_compressed":3299280,"data_compressed_allocated":31956992,"data_compressed_original":63913984,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31936512,"data_stored":63873024,"data_compressed":3297273,"data_compressed_allocated":31936512,"data_compressed_original":63873024,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":27619328,"data_stored":55238656,"data_compressed":2851493,"data_compressed_allocated":27619328,"data_compressed_original":55238656,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26562560,"data_stored":53125120,"data_compressed":2742445,"data_compressed_allocated":26562560,"data_compressed_original":53125120,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:35.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:35.470+0000 7f8324ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:35.461 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:35.477+0000 7f8324ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:35.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 10112 10096 1.09539 0.921875 0.0491412 0.113954 2024-04-25T09:34:36.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 10250 10234 1.09515 1.07812 0.167718 0.114032 2024-04-25T09:34:37.642 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:37.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 10371 10355 1.09312 0.945312 0.238912 0.114208 2024-04-25T09:34:37.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:37.788+0000 7f6ec342d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:37.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:37.796+0000 7f6ec342d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:38.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 10502 10486 1.09219 1.02344 0.172717 0.1143 2024-04-25T09:34:39.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 10635 10619 1.09149 1.03906 0.11957 0.114437 2024-04-25T09:34:39.930 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:40.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:40.087+0000 7f2d2a46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:40.079 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:40.095+0000 7f2d2a46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:40.415 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:40.416 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:40.416 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:40.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:40.555+0000 7f2cd3fd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:40.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:40.564+0000 7f2cd3fd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:40.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 10766 10750 1.09061 1.02344 0.0418013 0.114483 2024-04-25T09:34:40.775 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:40.776 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:40.790 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-04-25T09:34:39.313614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84804128,"num_objects":1289,"num_object_clones":0,"num_object_copies":3867,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10417,"num_write_kb":84134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10361,"ondisk_log_size":10361,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":396580,"kb_used_data":124100,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377090780,"statfs":{"total":386547056640,"available":386140958720,"internally_reserved":0,"allocated":127078400,"data_stored":252700208,"data_compressed":13011759,"data_compressed_allocated":125280256,"data_compressed_original":252035072,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13492224,"num_objects":207,"num_object_clones":0,"num_object_copies":621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1647,"num_write_kb":13176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002906"},"pg_stats":[{"pgid":"6.f","version":"51'701","reported_seq":714,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:37.414164+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:34:37.414164+0000","last_peered":"2024-04-25T09:34:37.414164+0000","last_clean":"2024-04-25T09:34:37.414164+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:34:37.414164+0000","last_undegraded":"2024-04-25T09:34:37.414164+0000","last_fullsized":"2024-04-25T09:34:37.414164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5750784,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":702,"num_write_kb":5616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'615","reported_seq":628,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:35.876250+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:34:35.876250+0000","last_peered":"2024-04-25T09:34:35.876250+0000","last_clean":"2024-04-25T09:34:35.876250+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:34:35.876250+0000","last_undegraded":"2024-04-25T09:34:35.876250+0000","last_fullsized":"2024-04-25T09:34:35.876250+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'647","reported_seq":660,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:34.801578+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:34:34.801578+0000","last_peered":"2024-04-25T09:34:34.801578+0000","last_clean":"2024-04-25T09:34:34.801578+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:34:34.801578+0000","last_undegraded":"2024-04-25T09:34:34.801578+0000","last_fullsized":"2024-04-25T09:34:34.801578+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'759","reported_seq":772,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:35.153161+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:34:35.153161+0000","last_peered":"2024-04-25T09:34:35.153161+0000","last_clean":"2024-04-25T09:34:35.153161+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:34:35.153161+0000","last_undegraded":"2024-04-25T09:34:35.153161+0000","last_fullsized":"2024-04-25T09:34:35.153161+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'561","reported_seq":574,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:36.433604+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:34:36.433604+0000","last_peered":"2024-04-25T09:34:36.433604+0000","last_clean":"2024-04-25T09:34:36.433604+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:34:36.433604+0000","last_undegraded":"2024-04-25T09:34:36.433604+0000","last_fullsized":"2024-04-25T09:34:36.433604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4603904,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":4496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'615","reported_seq":628,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:33.984493+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:34:33.984493+0000","last_peered":"2024-04-25T09:34:33.984493+0000","last_clean":"2024-04-25T09:34:33.984493+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:34:33.984493+0000","last_undegraded":"2024-04-25T09:34:33.984493+0000","last_fullsized":"2024-04-25T09:34:33.984493+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'575","reported_seq":588,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:37.232963+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:34:37.232963+0000","last_peered":"2024-04-25T09:34:37.232963+0000","last_clean":"2024-04-25T09:34:37.232963+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:34:37.232963+0000","last_undegraded":"2024-04-25T09:34:37.232963+0000","last_fullsized":"2024-04-25T09:34:37.232963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'596","reported_seq":609,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:36.429784+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:34:36.429784+0000","last_peered":"2024-04-25T09:34:36.429784+0000","last_clean":"2024-04-25T09:34:36.429784+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:34:36.429784+0000","last_undegraded":"2024-04-25T09:34:36.429784+0000","last_fullsized":"2024-04-25T09:34:36.429784+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4890624,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":597,"num_write_kb":4776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'527","reported_seq":540,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:34.991475+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:34:34.991475+0000","last_peered":"2024-04-25T09:34:34.991475+0000","last_clean":"2024-04-25T09:34:34.991475+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:34:34.991475+0000","last_undegraded":"2024-04-25T09:34:34.991475+0000","last_fullsized":"2024-04-25T09:34:34.991475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'695","reported_seq":708,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:36.633667+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:34:36.633667+0000","last_peered":"2024-04-25T09:34:36.633667+0000","last_clean":"2024-04-25T09:34:36.633667+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:34:36.633667+0000","last_undegraded":"2024-04-25T09:34:36.633667+0000","last_fullsized":"2024-04-25T09:34:36.633667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'679","reported_seq":692,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:36.961403+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:34:36.961403+0000","last_peered":"2024-04-25T09:34:36.961403+0000","last_clean":"2024-04-25T09:34:36.961403+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:34:36.961403+0000","last_undegraded":"2024-04-25T09:34:36.961403+0000","last_fullsized":"2024-04-25T09:34:36.961403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'551","reported_seq":564,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:37.364445+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:34:37.364445+0000","last_peered":"2024-04-25T09:34:37.364445+0000","last_clean":"2024-04-25T09:34:37.364445+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:34:37.364445+0000","last_undegraded":"2024-04-25T09:34:37.364445+0000","last_fullsized":"2024-04-25T09:34:37.364445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'602","reported_seq":615,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:37.444149+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:34:37.444149+0000","last_peered":"2024-04-25T09:34:37.444149+0000","last_clean":"2024-04-25T09:34:37.444149+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:34:37.444149+0000","last_undegraded":"2024-04-25T09:34:37.444149+0000","last_fullsized":"2024-04-25T09:34:37.444149+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4939776,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":603,"num_write_kb":4824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'711","reported_seq":724,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:35.879444+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:34:35.879444+0000","last_peered":"2024-04-25T09:34:35.879444+0000","last_clean":"2024-04-25T09:34:35.879444+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:34:35.879444+0000","last_undegraded":"2024-04-25T09:34:35.879444+0000","last_fullsized":"2024-04-25T09:34:35.879444+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'759","reported_seq":772,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:36.279867+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:34:36.279867+0000","last_peered":"2024-04-25T09:34:36.279867+0000","last_clean":"2024-04-25T09:34:36.279867+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:34:36.279867+0000","last_undegraded":"2024-04-25T09:34:36.279867+0000","last_fullsized":"2024-04-25T09:34:36.279867+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'671","reported_seq":684,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:36.361882+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:34:36.361882+0000","last_peered":"2024-04-25T09:34:36.361882+0000","last_clean":"2024-04-25T09:34:36.361882+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:34:36.361882+0000","last_undegraded":"2024-04-25T09:34:36.361882+0000","last_fullsized":"2024-04-25T09:34:36.361882+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":84213760,"num_objects":1287,"num_object_clones":0,"num_object_copies":3861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10280,"num_write_kb":82240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126001152,"data_stored":252002304,"data_compressed":13008996,"data_compressed_allocated":126001152,"data_compressed_original":252002304,"omap_allocated":0,"internal_metadata":0},"log_size":10264,"ondisk_log_size":10264,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94960,"kb_used_data":27880,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94276880,"statfs":{"total":96636764160,"available":96539525120,"internally_reserved":0,"allocated":28549120,"data_stored":56850964,"data_compressed":2926384,"data_compressed_allocated":28094464,"data_compressed_original":56680448,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104552,"kb_used_data":29152,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94267288,"statfs":{"total":96636764160,"available":96529702912,"internally_reserved":0,"allocated":29851648,"data_stored":59456020,"data_compressed":3060812,"data_compressed_allocated":29396992,"data_compressed_original":59285504,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96444,"kb_used_data":33524,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94275396,"statfs":{"total":96636764160,"available":96538005504,"internally_reserved":0,"allocated":34328576,"data_stored":67942388,"data_compressed":3499467,"data_compressed_allocated":33894400,"data_compressed_original":67788800,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100624,"kb_used_data":33544,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94271216,"statfs":{"total":96636764160,"available":96533725184,"internally_reserved":0,"allocated":34349056,"data_stored":68450836,"data_compressed":3525096,"data_compressed_allocated":33894400,"data_compressed_original":68280320,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34103296,"data_stored":68206592,"data_compressed":3520932,"data_compressed_allocated":34103296,"data_compressed_original":68206592,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34119680,"data_stored":68239360,"data_compressed":3522732,"data_compressed_allocated":34119680,"data_compressed_original":68239360,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29560832,"data_stored":59121664,"data_compressed":3051995,"data_compressed_allocated":29560832,"data_compressed_original":59121664,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28217344,"data_stored":56434688,"data_compressed":2913337,"data_compressed_allocated":28217344,"data_compressed_original":56434688,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:41.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 10904 10888 1.09045 1.07812 0.186347 0.114535 2024-04-25T09:34:42.245 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:42.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:42.407+0000 7f1348aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:42.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:42.413+0000 7f1348aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:42.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 11025 11009 1.08861 0.945312 0.145418 0.114715 2024-04-25T09:34:43.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:34:43.780651+0000 min lat: 0.0145835 max lat: 0.423737 avg lat: 0.11484 2024-04-25T09:34:43.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:34:43.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 16 11149 11133 1.08711 0.96875 0.0333489 0.11484 2024-04-25T09:34:44.606 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:44.750 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:44.764+0000 7efec046d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:44.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:44.770+0000 7efec046d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:44.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 11268 11252 1.08516 0.929688 0.0780479 0.115083 2024-04-25T09:34:45.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 11399 11383 1.08441 1.02344 0.168934 0.115179 2024-04-25T09:34:45.791 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:45.792 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:45.792 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:45.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:45.929+0000 7f605686d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:45.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:45.939+0000 7f605686d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:46.162 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:46.162 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:46.177 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-25T09:34:45.314985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":90153504,"num_objects":1370,"num_object_clones":0,"num_object_copies":4110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11070,"num_write_kb":89358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11014,"ondisk_log_size":11014,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":408504,"kb_used_data":131860,"kb_used_omap":0,"kb_used_meta":276608,"kb_avail":377078856,"statfs":{"total":386547056640,"available":386128748544,"internally_reserved":0,"allocated":135024640,"data_stored":268592688,"data_compressed":13832379,"data_compressed_allocated":133226496,"data_compressed_original":267927552,"omap_allocated":0,"internal_metadata":283246592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10911744,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1332,"num_write_kb":10656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002801"},"pg_stats":[{"pgid":"6.f","version":"51'719","reported_seq":732,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:41.918064+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:34:41.918064+0000","last_peered":"2024-04-25T09:34:41.918064+0000","last_clean":"2024-04-25T09:34:41.918064+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:34:41.918064+0000","last_undegraded":"2024-04-25T09:34:41.918064+0000","last_fullsized":"2024-04-25T09:34:41.918064+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'663","reported_seq":676,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:41.138852+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:34:41.138852+0000","last_peered":"2024-04-25T09:34:41.138852+0000","last_clean":"2024-04-25T09:34:41.138852+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:34:41.138852+0000","last_undegraded":"2024-04-25T09:34:41.138852+0000","last_fullsized":"2024-04-25T09:34:41.138852+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'679","reported_seq":692,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:39.915207+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:34:39.915207+0000","last_peered":"2024-04-25T09:34:39.915207+0000","last_clean":"2024-04-25T09:34:39.915207+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:34:39.915207+0000","last_undegraded":"2024-04-25T09:34:39.915207+0000","last_fullsized":"2024-04-25T09:34:39.915207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'791","reported_seq":804,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:42.045719+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:34:42.045719+0000","last_peered":"2024-04-25T09:34:42.045719+0000","last_clean":"2024-04-25T09:34:42.045719+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:34:42.045719+0000","last_undegraded":"2024-04-25T09:34:42.045719+0000","last_fullsized":"2024-04-25T09:34:42.045719+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'575","reported_seq":588,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:38.016437+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:34:38.016437+0000","last_peered":"2024-04-25T09:34:38.016437+0000","last_clean":"2024-04-25T09:34:38.016437+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:34:38.016437+0000","last_undegraded":"2024-04-25T09:34:38.016437+0000","last_fullsized":"2024-04-25T09:34:38.016437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'695","reported_seq":708,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:42.193391+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:34:42.193391+0000","last_peered":"2024-04-25T09:34:42.193391+0000","last_clean":"2024-04-25T09:34:42.193391+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:34:42.193391+0000","last_undegraded":"2024-04-25T09:34:42.193391+0000","last_fullsized":"2024-04-25T09:34:42.193391+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'628","reported_seq":641,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:42.436586+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:34:42.436586+0000","last_peered":"2024-04-25T09:34:42.436586+0000","last_clean":"2024-04-25T09:34:42.436586+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:34:42.436586+0000","last_undegraded":"2024-04-25T09:34:42.436586+0000","last_fullsized":"2024-04-25T09:34:42.436586+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5152768,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":629,"num_write_kb":5032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'631","reported_seq":644,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:41.220358+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:34:41.220358+0000","last_peered":"2024-04-25T09:34:41.220358+0000","last_clean":"2024-04-25T09:34:41.220358+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:34:41.220358+0000","last_undegraded":"2024-04-25T09:34:41.220358+0000","last_fullsized":"2024-04-25T09:34:41.220358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'545","reported_seq":558,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:41.435729+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:34:41.435729+0000","last_peered":"2024-04-25T09:34:41.435729+0000","last_clean":"2024-04-25T09:34:41.435729+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:34:41.435729+0000","last_undegraded":"2024-04-25T09:34:41.435729+0000","last_fullsized":"2024-04-25T09:34:41.435729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4472832,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":546,"num_write_kb":4368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'743","reported_seq":756,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:40.973935+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:34:40.973935+0000","last_peered":"2024-04-25T09:34:40.973935+0000","last_clean":"2024-04-25T09:34:40.973935+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:34:40.973935+0000","last_undegraded":"2024-04-25T09:34:40.973935+0000","last_fullsized":"2024-04-25T09:34:40.973935+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'727","reported_seq":740,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:42.022416+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:34:42.022416+0000","last_peered":"2024-04-25T09:34:42.022416+0000","last_clean":"2024-04-25T09:34:42.022416+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:34:42.022416+0000","last_undegraded":"2024-04-25T09:34:42.022416+0000","last_fullsized":"2024-04-25T09:34:42.022416+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'607","reported_seq":620,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:41.766121+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:34:41.766121+0000","last_peered":"2024-04-25T09:34:41.766121+0000","last_clean":"2024-04-25T09:34:41.766121+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:34:41.766121+0000","last_undegraded":"2024-04-25T09:34:41.766121+0000","last_fullsized":"2024-04-25T09:34:41.766121+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'639","reported_seq":652,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:42.324765+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:34:42.324765+0000","last_peered":"2024-04-25T09:34:42.324765+0000","last_clean":"2024-04-25T09:34:42.324765+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:34:42.324765+0000","last_undegraded":"2024-04-25T09:34:42.324765+0000","last_fullsized":"2024-04-25T09:34:42.324765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'751","reported_seq":764,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:42.433897+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:34:42.433897+0000","last_peered":"2024-04-25T09:34:42.433897+0000","last_clean":"2024-04-25T09:34:42.433897+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:34:42.433897+0000","last_undegraded":"2024-04-25T09:34:42.433897+0000","last_fullsized":"2024-04-25T09:34:42.433897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'815","reported_seq":828,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:40.612348+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:34:40.612348+0000","last_peered":"2024-04-25T09:34:40.612348+0000","last_clean":"2024-04-25T09:34:40.612348+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:34:40.612348+0000","last_undegraded":"2024-04-25T09:34:40.612348+0000","last_fullsized":"2024-04-25T09:34:40.612348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'709","reported_seq":722,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:41.423460+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:34:41.423460+0000","last_peered":"2024-04-25T09:34:41.423460+0000","last_clean":"2024-04-25T09:34:41.423460+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:34:41.423460+0000","last_undegraded":"2024-04-25T09:34:41.423460+0000","last_fullsized":"2024-04-25T09:34:41.423460+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5816320,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":5680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":89563136,"num_objects":1368,"num_object_clones":0,"num_object_copies":4104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10933,"num_write_kb":87464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134021120,"data_stored":268042240,"data_compressed":13837230,"data_compressed_allocated":134021120,"data_compressed_original":268042240,"omap_allocated":0,"internal_metadata":0},"log_size":10917,"ondisk_log_size":10917,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100804,"kb_used_data":29560,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94271036,"statfs":{"total":96636764160,"available":96533540864,"internally_reserved":0,"allocated":30269440,"data_stored":60291604,"data_compressed":3104044,"data_compressed_allocated":29814784,"data_compressed_original":60121088,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673379,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106312,"kb_used_data":30912,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94265528,"statfs":{"total":96636764160,"available":96527900672,"internally_reserved":0,"allocated":31653888,"data_stored":63060500,"data_compressed":3246932,"data_compressed_allocated":31199232,"data_compressed_original":62889984,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98568,"kb_used_data":35648,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94273272,"statfs":{"total":96636764160,"available":96535830528,"internally_reserved":0,"allocated":36503552,"data_stored":72292340,"data_compressed":3724080,"data_compressed_allocated":36069376,"data_compressed_original":72138752,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102820,"kb_used_data":35740,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94269020,"statfs":{"total":96636764160,"available":96531476480,"internally_reserved":0,"allocated":36597760,"data_stored":72948244,"data_compressed":3757323,"data_compressed_allocated":36143104,"data_compressed_original":72777728,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36347904,"data_stored":72695808,"data_compressed":3752736,"data_compressed_allocated":36347904,"data_compressed_original":72695808,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36339712,"data_stored":72679424,"data_compressed":3751998,"data_compressed_allocated":36339712,"data_compressed_original":72679424,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31363072,"data_stored":62726144,"data_compressed":3238115,"data_compressed_allocated":31363072,"data_compressed_original":62726144,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29970432,"data_stored":59940864,"data_compressed":3094381,"data_compressed_allocated":29970432,"data_compressed_original":59940864,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:46.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 16 11545 11529 1.08509 1.14062 0.0889681 0.115103 2024-04-25T09:34:46.960 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:47.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:47.110+0000 7fd1056ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:47.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:47.117+0000 7fd1056ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:47.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 11683 11667 1.085 1.07812 0.135582 0.115127 2024-04-25T09:34:48.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 11807 11791 1.08363 0.96875 0.161769 0.115236 2024-04-25T09:34:49.320 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:49.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:49.459+0000 7f071cead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:49.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:49.466+0000 7f071cead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:49.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 11940 11924 1.08311 1.03906 0.154469 0.115279 2024-04-25T09:34:50.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 12070 12054 1.08234 1.01562 0.0352134 0.11538 2024-04-25T09:34:51.179 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:51.179 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:51.180 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:34:51.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:51.310+0000 7fe879b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:51.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:51.319+0000 7fe879b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:51.541 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:34:51.542 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:34:51.557 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-04-25T09:34:51.316260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":95248928,"num_objects":1449,"num_object_clones":0,"num_object_copies":4347,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11692,"num_write_kb":94334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11636,"ondisk_log_size":11636,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":412088,"kb_used_data":139600,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377075272,"statfs":{"total":386547056640,"available":386125078528,"internally_reserved":0,"allocated":142950400,"data_stored":284444208,"data_compressed":14650881,"data_compressed_allocated":141152256,"data_compressed_original":283779072,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10444800,"num_objects":160,"num_object_clones":0,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1275,"num_write_kb":10200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002645"},"pg_stats":[{"pgid":"6.f","version":"51'759","reported_seq":772,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:46.605599+0000","last_change":"2024-04-25T09:33:22.827157+0000","last_active":"2024-04-25T09:34:46.605599+0000","last_peered":"2024-04-25T09:34:46.605599+0000","last_clean":"2024-04-25T09:34:46.605599+0000","last_became_active":"2024-04-25T09:33:22.822525+0000","last_became_peered":"2024-04-25T09:33:22.822525+0000","last_unstale":"2024-04-25T09:34:46.605599+0000","last_undegraded":"2024-04-25T09:34:46.605599+0000","last_fullsized":"2024-04-25T09:34:46.605599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"51'703","reported_seq":716,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:45.501146+0000","last_change":"2024-04-25T09:33:22.940141+0000","last_active":"2024-04-25T09:34:45.501146+0000","last_peered":"2024-04-25T09:34:45.501146+0000","last_clean":"2024-04-25T09:34:45.501146+0000","last_became_active":"2024-04-25T09:33:22.929983+0000","last_became_peered":"2024-04-25T09:33:22.929983+0000","last_unstale":"2024-04-25T09:34:45.501146+0000","last_undegraded":"2024-04-25T09:34:45.501146+0000","last_fullsized":"2024-04-25T09:34:45.501146+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"51'711","reported_seq":724,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:45.290466+0000","last_change":"2024-04-25T09:33:22.899872+0000","last_active":"2024-04-25T09:34:45.290466+0000","last_peered":"2024-04-25T09:34:45.290466+0000","last_clean":"2024-04-25T09:34:45.290466+0000","last_became_active":"2024-04-25T09:33:22.891314+0000","last_became_peered":"2024-04-25T09:33:22.891314+0000","last_unstale":"2024-04-25T09:34:45.290466+0000","last_undegraded":"2024-04-25T09:34:45.290466+0000","last_fullsized":"2024-04-25T09:34:45.290466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"51'816","reported_seq":829,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:46.998168+0000","last_change":"2024-04-25T09:33:22.885617+0000","last_active":"2024-04-25T09:34:46.998168+0000","last_peered":"2024-04-25T09:34:46.998168+0000","last_clean":"2024-04-25T09:34:46.998168+0000","last_became_active":"2024-04-25T09:33:22.878213+0000","last_became_peered":"2024-04-25T09:33:22.878213+0000","last_unstale":"2024-04-25T09:34:46.998168+0000","last_undegraded":"2024-04-25T09:34:46.998168+0000","last_fullsized":"2024-04-25T09:34:46.998168+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6692864,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":817,"num_write_kb":6536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"51'599","reported_seq":612,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:46.283603+0000","last_change":"2024-04-25T09:33:22.881871+0000","last_active":"2024-04-25T09:34:46.283603+0000","last_peered":"2024-04-25T09:34:46.283603+0000","last_clean":"2024-04-25T09:34:46.283603+0000","last_became_active":"2024-04-25T09:33:22.874553+0000","last_became_peered":"2024-04-25T09:33:22.874553+0000","last_unstale":"2024-04-25T09:34:46.283603+0000","last_undegraded":"2024-04-25T09:34:46.283603+0000","last_fullsized":"2024-04-25T09:34:46.283603+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"51'711","reported_seq":724,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:45.913857+0000","last_change":"2024-04-25T09:33:22.813857+0000","last_active":"2024-04-25T09:34:45.913857+0000","last_peered":"2024-04-25T09:34:45.913857+0000","last_clean":"2024-04-25T09:34:45.913857+0000","last_became_active":"2024-04-25T09:33:22.809102+0000","last_became_peered":"2024-04-25T09:33:22.809102+0000","last_unstale":"2024-04-25T09:34:45.913857+0000","last_undegraded":"2024-04-25T09:34:45.913857+0000","last_fullsized":"2024-04-25T09:34:45.913857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"51'719","reported_seq":732,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:47.412318+0000","last_change":"2024-04-25T09:33:22.867101+0000","last_active":"2024-04-25T09:34:47.412318+0000","last_peered":"2024-04-25T09:34:47.412318+0000","last_clean":"2024-04-25T09:34:47.412318+0000","last_became_active":"2024-04-25T09:33:22.844389+0000","last_became_peered":"2024-04-25T09:33:22.844389+0000","last_unstale":"2024-04-25T09:34:47.412318+0000","last_undegraded":"2024-04-25T09:34:47.412318+0000","last_fullsized":"2024-04-25T09:34:47.412318+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"51'655","reported_seq":668,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:43.952128+0000","last_change":"2024-04-25T09:33:22.898287+0000","last_active":"2024-04-25T09:34:43.952128+0000","last_peered":"2024-04-25T09:34:43.952128+0000","last_clean":"2024-04-25T09:34:43.952128+0000","last_became_active":"2024-04-25T09:33:22.888082+0000","last_became_peered":"2024-04-25T09:33:22.888082+0000","last_unstale":"2024-04-25T09:34:43.952128+0000","last_undegraded":"2024-04-25T09:34:43.952128+0000","last_fullsized":"2024-04-25T09:34:43.952128+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"51'582","reported_seq":595,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:46.422633+0000","last_change":"2024-04-25T09:33:22.872566+0000","last_active":"2024-04-25T09:34:46.422633+0000","last_peered":"2024-04-25T09:34:46.422633+0000","last_clean":"2024-04-25T09:34:46.422633+0000","last_became_active":"2024-04-25T09:33:22.856399+0000","last_became_peered":"2024-04-25T09:33:22.856399+0000","last_unstale":"2024-04-25T09:34:46.422633+0000","last_undegraded":"2024-04-25T09:34:46.422633+0000","last_fullsized":"2024-04-25T09:34:46.422633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4775936,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":583,"num_write_kb":4664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":241,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.535625+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:33:24.535625+0000","last_peered":"2024-04-25T09:33:24.535625+0000","last_clean":"2024-04-25T09:33:24.535625+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:33:24.535625+0000","last_undegraded":"2024-04-25T09:33:24.535625+0000","last_fullsized":"2024-04-25T09:33:24.535625+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.726276+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:33:23.726276+0000","last_peered":"2024-04-25T09:33:23.726276+0000","last_clean":"2024-04-25T09:33:23.726276+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:33:23.726276+0000","last_undegraded":"2024-04-25T09:33:23.726276+0000","last_fullsized":"2024-04-25T09:33:23.726276+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"51'780","reported_seq":793,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:47.423890+0000","last_change":"2024-04-25T09:33:22.898249+0000","last_active":"2024-04-25T09:34:47.423890+0000","last_peered":"2024-04-25T09:34:47.423890+0000","last_clean":"2024-04-25T09:34:47.423890+0000","last_became_active":"2024-04-25T09:33:22.889712+0000","last_became_peered":"2024-04-25T09:33:22.889712+0000","last_unstale":"2024-04-25T09:34:47.423890+0000","last_undegraded":"2024-04-25T09:34:47.423890+0000","last_fullsized":"2024-04-25T09:34:47.423890+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6397952,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":6248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.805661+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:33:23.805661+0000","last_peered":"2024-04-25T09:33:23.805661+0000","last_clean":"2024-04-25T09:33:23.805661+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:33:23.805661+0000","last_undegraded":"2024-04-25T09:33:23.805661+0000","last_fullsized":"2024-04-25T09:33:23.805661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"51'767","reported_seq":780,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:47.212095+0000","last_change":"2024-04-25T09:33:22.876675+0000","last_active":"2024-04-25T09:34:47.212095+0000","last_peered":"2024-04-25T09:34:47.212095+0000","last_clean":"2024-04-25T09:34:47.212095+0000","last_became_active":"2024-04-25T09:33:22.871691+0000","last_became_peered":"2024-04-25T09:33:22.871691+0000","last_unstale":"2024-04-25T09:34:47.212095+0000","last_undegraded":"2024-04-25T09:34:47.212095+0000","last_fullsized":"2024-04-25T09:34:47.212095+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.713212+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:33:23.713212+0000","last_peered":"2024-04-25T09:33:23.713212+0000","last_clean":"2024-04-25T09:33:23.713212+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:33:23.713212+0000","last_undegraded":"2024-04-25T09:33:23.713212+0000","last_fullsized":"2024-04-25T09:33:23.713212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"51'631","reported_seq":644,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:45.233215+0000","last_change":"2024-04-25T09:33:22.861090+0000","last_active":"2024-04-25T09:34:45.233215+0000","last_peered":"2024-04-25T09:34:45.233215+0000","last_clean":"2024-04-25T09:34:45.233215+0000","last_became_active":"2024-04-25T09:33:22.837112+0000","last_became_peered":"2024-04-25T09:33:22.837112+0000","last_unstale":"2024-04-25T09:34:45.233215+0000","last_undegraded":"2024-04-25T09:34:45.233215+0000","last_fullsized":"2024-04-25T09:34:45.233215+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":104,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.813976+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:33:23.813976+0000","last_peered":"2024-04-25T09:33:23.813976+0000","last_clean":"2024-04-25T09:33:23.813976+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:33:23.813976+0000","last_undegraded":"2024-04-25T09:33:23.813976+0000","last_fullsized":"2024-04-25T09:33:23.813976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"51'703","reported_seq":716,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:47.018537+0000","last_change":"2024-04-25T09:33:22.910309+0000","last_active":"2024-04-25T09:34:47.018537+0000","last_peered":"2024-04-25T09:34:47.018537+0000","last_clean":"2024-04-25T09:34:47.018537+0000","last_became_active":"2024-04-25T09:33:22.900887+0000","last_became_peered":"2024-04-25T09:33:22.900887+0000","last_unstale":"2024-04-25T09:34:47.018537+0000","last_undegraded":"2024-04-25T09:34:47.018537+0000","last_fullsized":"2024-04-25T09:34:47.018537+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.865038+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:33:23.865038+0000","last_peered":"2024-04-25T09:33:23.865038+0000","last_clean":"2024-04-25T09:33:23.865038+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:33:23.865038+0000","last_undegraded":"2024-04-25T09:33:23.865038+0000","last_fullsized":"2024-04-25T09:33:23.865038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"51'786","reported_seq":799,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:47.445993+0000","last_change":"2024-04-25T09:33:22.836582+0000","last_active":"2024-04-25T09:34:47.445993+0000","last_peered":"2024-04-25T09:34:47.445993+0000","last_clean":"2024-04-25T09:34:47.445993+0000","last_became_active":"2024-04-25T09:33:22.831267+0000","last_became_peered":"2024-04-25T09:33:22.831267+0000","last_unstale":"2024-04-25T09:34:47.445993+0000","last_undegraded":"2024-04-25T09:34:47.445993+0000","last_fullsized":"2024-04-25T09:34:47.445993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6447104,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":787,"num_write_kb":6296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:24.538511+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:33:24.538511+0000","last_peered":"2024-04-25T09:33:24.538511+0000","last_clean":"2024-04-25T09:33:24.538511+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:33:24.538511+0000","last_undegraded":"2024-04-25T09:33:24.538511+0000","last_fullsized":"2024-04-25T09:33:24.538511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"51'871","reported_seq":884,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:46.393517+0000","last_change":"2024-04-25T09:33:22.879868+0000","last_active":"2024-04-25T09:34:46.393517+0000","last_peered":"2024-04-25T09:34:46.393517+0000","last_clean":"2024-04-25T09:34:46.393517+0000","last_became_active":"2024-04-25T09:33:22.869247+0000","last_became_peered":"2024-04-25T09:33:22.869247+0000","last_unstale":"2024-04-25T09:34:46.393517+0000","last_undegraded":"2024-04-25T09:34:46.393517+0000","last_fullsized":"2024-04-25T09:34:46.393517+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7143424,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":110,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.839767+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:33:23.839767+0000","last_peered":"2024-04-25T09:33:23.839767+0000","last_clean":"2024-04-25T09:33:23.839767+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:33:23.839767+0000","last_undegraded":"2024-04-25T09:33:23.839767+0000","last_fullsized":"2024-04-25T09:33:23.839767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"51'746","reported_seq":759,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:34:46.435971+0000","last_change":"2024-04-25T09:33:22.934561+0000","last_active":"2024-04-25T09:34:46.435971+0000","last_peered":"2024-04-25T09:34:46.435971+0000","last_clean":"2024-04-25T09:34:46.435971+0000","last_became_active":"2024-04-25T09:33:22.924925+0000","last_became_peered":"2024-04-25T09:33:22.924925+0000","last_unstale":"2024-04-25T09:34:46.435971+0000","last_undegraded":"2024-04-25T09:34:46.435971+0000","last_fullsized":"2024-04-25T09:34:46.435971+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:33:21.677244+0000","last_clean_scrub_stamp":"2024-04-25T09:33:21.677244+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119424,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":5976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T09:33:23.728111+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:33:23.728111+0000","last_peered":"2024-04-25T09:33:23.728111+0000","last_clean":"2024-04-25T09:33:23.728111+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:33:23.728111+0000","last_undegraded":"2024-04-25T09:33:23.728111+0000","last_fullsized":"2024-04-25T09:33:23.728111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":94658560,"num_objects":1447,"num_object_clones":0,"num_object_copies":4341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11555,"num_write_kb":92440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142000128,"data_stored":284000256,"data_compressed":14661231,"data_compressed_allocated":142000128,"data_compressed_original":284000256,"omap_allocated":0,"internal_metadata":0},"log_size":11539,"ondisk_log_size":11539,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102584,"kb_used_data":31344,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94269256,"statfs":{"total":96636764160,"available":96531718144,"internally_reserved":0,"allocated":32096256,"data_stored":63945236,"data_compressed":3292701,"data_compressed_allocated":31641600,"data_compressed_original":63774720,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673384,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95740,"kb_used_data":32816,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94276100,"statfs":{"total":96636764160,"available":96538726400,"internally_reserved":0,"allocated":33603584,"data_stored":66959892,"data_compressed":3448279,"data_compressed_allocated":33148928,"data_compressed_original":66789376,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104788,"kb_used_data":37704,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94267052,"statfs":{"total":96636764160,"available":96529461248,"internally_reserved":0,"allocated":38608896,"data_stored":76503028,"data_compressed":3941502,"data_compressed_allocated":38174720,"data_compressed_original":76349440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108976,"kb_used_data":37736,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94262864,"statfs":{"total":96636764160,"available":96525172736,"internally_reserved":0,"allocated":38641664,"data_stored":77036052,"data_compressed":3968399,"data_compressed_allocated":38187008,"data_compressed_original":76865536,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38375424,"data_stored":76750848,"data_compressed":3962120,"data_compressed_allocated":38375424,"data_compressed_original":76750848,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38477824,"data_stored":76955648,"data_compressed":3972804,"data_compressed_allocated":38477824,"data_compressed_original":76955648,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33337344,"data_stored":66674688,"data_compressed":3442000,"data_compressed_allocated":33337344,"data_compressed_original":66674688,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31809536,"data_stored":63619072,"data_compressed":3284307,"data_compressed_allocated":31809536,"data_compressed_original":63619072,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:34:51.623 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:51.743 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:51.756+0000 7f256c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:51.747 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:51.763+0000 7f256c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:51.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 12183 12167 1.08007 0.882812 0.0922657 0.115614 2024-04-25T09:34:52.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 12306 12290 1.07873 0.960938 0.171847 0.115756 2024-04-25T09:34:53.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 13 12445 12432 1.07907 1.10938 0.11825 0.115754 2024-04-25T09:34:53.908 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:54.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:54.029+0000 7f7d29a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:54.019 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:54.035+0000 7f7d29a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1485 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 12445 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.07852 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.0914857 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.26562 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.875 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 138 2024-04-25T09:34:54.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 11.7102 2024-04-25T09:34:54.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 162 2024-04-25T09:34:54.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 112 2024-04-25T09:34:54.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.115782 2024-04-25T09:34:54.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.0590157 2024-04-25T09:34:54.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.423737 2024-04-25T09:34:54.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0145835 2024-04-25T09:34:54.790 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:34:56.113 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:34:56.240 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:56.255+0000 7f9873c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:56.245 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:56.262+0000 7f9873c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:56.560 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:34:56.560 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:34:56.560 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:34:56.560 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:34:56.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:56.706+0000 7faea695d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:56.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:56.719+0000 7faea695d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:56.728 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:56.729 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:56.729 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:56.729 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:56.732 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:56.732 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:56.733 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:34:56.873 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:56.882+0000 7f014495d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:56.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:56.895+0000 7f014495d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:56.997 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:56.997 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:56.997 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:56.997 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:56.997 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:56.998 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:56.998 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:56.998 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:56.998 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:56.998 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:56.998 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:56.998 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:57.001 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:57.001 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:57.001 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:34:57.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:57.151+0000 7f07d746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:57.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:57.164+0000 7f07d746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:57.180 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:57.180 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:57.181 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:57.184 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:57.184 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:57.185 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:34:57.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:57.342+0000 7fdf0e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:57.339 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:57.355+0000 7fdf0e06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:34:57.414 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:34:57.415 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:34:57.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:34:57.418 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:34:58.539 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:34:58.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:58.695+0000 7f38044ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:34:58.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:34:58.703+0000 7f38044ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:01.079 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:01.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:01.233+0000 7fe91ce20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:01.223 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:01.239+0000 7fe91ce20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:02.418 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:02.419 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:02.419 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:35:02.419 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:35:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:02.567+0000 7fd8a826d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:02.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:02.582+0000 7fd8a826d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:02.630 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:02.631 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:02.634 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:02.634 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:02.634 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:35:02.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:02.796+0000 7f6c07e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:02.792 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:02.808+0000 7f6c07e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:02.934 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:02.935 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:02.937 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:02.937 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:02.938 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:35:03.093 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:03.101+0000 7fceec79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:03.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:03.114+0000 7fceec79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:03.122 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:03.123 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:03.125 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:03.126 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:03.126 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:35:03.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:03.297+0000 7f855b11d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:03.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:03.311+0000 7f855b11d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:03.362 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:03.362 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:03.362 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:03.362 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:03.362 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:03.362 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:03.362 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:03.363 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:03.363 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:03.363 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:03.363 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:03.363 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:03.366 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:03.367 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:03.458 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:03.595 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:03.609+0000 7f8bea95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:03.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:03.617+0000 7f8bea95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:04.839 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1556 objects 2024-04-25T09:35:04.839 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :10.0492 2024-04-25T09:35:05.914 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:06.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:06.042+0000 7fed1839d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:06.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:06.048+0000 7fed1839d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:07.418 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-04-25T09:35:07.418 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-04-25T09:35:07.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:07.540+0000 7f0c9479d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:07.552+0000 7f0c9479d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.131 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:08.237 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.251+0000 7efe3275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.241 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.257+0000 7efe3275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.358 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_3' removed 2024-04-25T09:35:08.367 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:08.367 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:08.367 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:35:08.367 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:35:08.372 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:35:08.373 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:35:08.373 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-04-25T09:35:08.373 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-04-25T09:35:08.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.489+0000 7f861cead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.498+0000 7f861cead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.501 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:08.501 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:08.501 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:08.501 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:08.501 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:08.501 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:08.501 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:08.502 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:08.502 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:08.502 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:08.502 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:08.502 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:08.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:08.504 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:08.505 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:35:08.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.539+0000 7f924846d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.550+0000 7f924846d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.615 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.626+0000 7fb33666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.635+0000 7fb33666d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:08.640 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:08.641 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:08.642 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:08.643 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:08.643 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:08.643 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:35:08.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.804+0000 7ff2d199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.797 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.813+0000 7ff2d199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:08.813 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:08.814 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:08.814 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:08.814 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:08.814 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:08.814 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:08.814 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:08.814 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:08.816 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:08.817 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:08.817 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:35:08.925 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.935+0000 7f45e195d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:08.944+0000 7f45e195d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:08.944 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:08.944 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:08.944 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:08.944 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:08.944 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:08.944 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:08.945 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:08.945 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:08.945 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:08.945 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:08.945 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:08.945 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:08.947 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:08.947 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:09.362 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_4' created 2024-04-25T09:35:09.383 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-04-25T09:35:09.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:09.557+0000 7fd75db5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:09.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:09.584+0000 7fd75db5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:10.340 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:10.366 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-04-25T09:35:10.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:10.490+0000 7faae4ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:10.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:10.499+0000 7faae4ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:11.387 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-04-25T09:35:11.390 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:35:11.390 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:35:11.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:35:11.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:35:11.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_47576 2024-04-25T09:35:11.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:35:11.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:35:12.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 147 131 1.02336 1.02344 0.0699562 0.112525 2024-04-25T09:35:12.736 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:12.885 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:12.899+0000 7f5529b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:12.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:12.907+0000 7f5529b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:13.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 283 267 1.04289 1.0625 0.127219 0.115832 2024-04-25T09:35:13.948 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:13.948 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:13.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:14.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:14.087+0000 7f267335d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:14.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:14.099+0000 7f267335d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:14.285 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:14.286 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:14.301 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-04-25T09:35:13.321375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1352224,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":230,"num_write_kb":2638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":182,"ondisk_log_size":182,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":291524,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":289088,"kb_avail":377195836,"statfs":{"total":386547056640,"available":386248536064,"internally_reserved":0,"allocated":2461696,"data_stored":3253482,"data_compressed":131981,"data_compressed_allocated":532480,"data_compressed_original":2539520,"omap_allocated":0,"internal_metadata":296026112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":761856,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.943493"},"pg_stats":[{"pgid":"7.f","version":"55'23","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:12.448795+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:12.448795+0000","last_peered":"2024-04-25T09:35:12.448795+0000","last_clean":"2024-04-25T09:35:12.448795+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:12.448795+0000","last_undegraded":"2024-04-25T09:35:12.448795+0000","last_fullsized":"2024-04-25T09:35:12.448795+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.460171+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:11.460171+0000","last_peered":"2024-04-25T09:35:11.460171+0000","last_clean":"2024-04-25T09:35:11.460171+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:11.460171+0000","last_undegraded":"2024-04-25T09:35:11.460171+0000","last_fullsized":"2024-04-25T09:35:11.460171+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"55'10","reported_seq":23,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:12.428486+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:12.428486+0000","last_peered":"2024-04-25T09:35:12.428486+0000","last_clean":"2024-04-25T09:35:12.428486+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:12.428486+0000","last_undegraded":"2024-04-25T09:35:12.428486+0000","last_fullsized":"2024-04-25T09:35:12.428486+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90112,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"55'7","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:12.253584+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:12.253584+0000","last_peered":"2024-04-25T09:35:12.253584+0000","last_clean":"2024-04-25T09:35:12.253584+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:12.253584+0000","last_undegraded":"2024-04-25T09:35:12.253584+0000","last_fullsized":"2024-04-25T09:35:12.253584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"55'23","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:12.159728+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:12.159728+0000","last_peered":"2024-04-25T09:35:12.159728+0000","last_clean":"2024-04-25T09:35:12.159728+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:12.159728+0000","last_undegraded":"2024-04-25T09:35:12.159728+0000","last_fullsized":"2024-04-25T09:35:12.159728+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"55'7","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:12.372618+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:12.372618+0000","last_peered":"2024-04-25T09:35:12.372618+0000","last_clean":"2024-04-25T09:35:12.372618+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:12.372618+0000","last_undegraded":"2024-04-25T09:35:12.372618+0000","last_fullsized":"2024-04-25T09:35:12.372618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.408381+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:11.408381+0000","last_peered":"2024-04-25T09:35:11.408381+0000","last_clean":"2024-04-25T09:35:11.408381+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:11.408381+0000","last_undegraded":"2024-04-25T09:35:11.408381+0000","last_fullsized":"2024-04-25T09:35:11.408381+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.458860+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:11.458860+0000","last_peered":"2024-04-25T09:35:11.458860+0000","last_clean":"2024-04-25T09:35:11.458860+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:11.458860+0000","last_undegraded":"2024-04-25T09:35:11.458860+0000","last_fullsized":"2024-04-25T09:35:11.458860+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"55'7","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.864640+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:11.864640+0000","last_peered":"2024-04-25T09:35:11.864640+0000","last_clean":"2024-04-25T09:35:11.864640+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:11.864640+0000","last_undegraded":"2024-04-25T09:35:11.864640+0000","last_fullsized":"2024-04-25T09:35:11.864640+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":253,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.463003+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:11.463003+0000","last_peered":"2024-04-25T09:35:11.463003+0000","last_clean":"2024-04-25T09:35:11.463003+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:11.463003+0000","last_undegraded":"2024-04-25T09:35:11.463003+0000","last_fullsized":"2024-04-25T09:35:11.463003+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.472953+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:11.472953+0000","last_peered":"2024-04-25T09:35:11.472953+0000","last_clean":"2024-04-25T09:35:11.472953+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:11.472953+0000","last_undegraded":"2024-04-25T09:35:11.472953+0000","last_fullsized":"2024-04-25T09:35:11.472953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.456387+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:11.456387+0000","last_peered":"2024-04-25T09:35:11.456387+0000","last_clean":"2024-04-25T09:35:11.456387+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:11.456387+0000","last_undegraded":"2024-04-25T09:35:11.456387+0000","last_fullsized":"2024-04-25T09:35:11.456387+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.494545+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:11.494545+0000","last_peered":"2024-04-25T09:35:11.494545+0000","last_clean":"2024-04-25T09:35:11.494545+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:11.494545+0000","last_undegraded":"2024-04-25T09:35:11.494545+0000","last_fullsized":"2024-04-25T09:35:11.494545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.404245+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:11.404245+0000","last_peered":"2024-04-25T09:35:11.404245+0000","last_clean":"2024-04-25T09:35:11.404245+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:11.404245+0000","last_undegraded":"2024-04-25T09:35:11.404245+0000","last_fullsized":"2024-04-25T09:35:11.404245+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.465127+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:11.465127+0000","last_peered":"2024-04-25T09:35:11.465127+0000","last_clean":"2024-04-25T09:35:11.465127+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:11.465127+0000","last_undegraded":"2024-04-25T09:35:11.465127+0000","last_fullsized":"2024-04-25T09:35:11.465127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:10.613091+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:10.613091+0000","last_peered":"2024-04-25T09:35:10.613091+0000","last_clean":"2024-04-25T09:35:10.613091+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:10.613091+0000","last_undegraded":"2024-04-25T09:35:10.613091+0000","last_fullsized":"2024-04-25T09:35:10.613091+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.472267+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:11.472267+0000","last_peered":"2024-04-25T09:35:11.472267+0000","last_clean":"2024-04-25T09:35:11.472267+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:11.472267+0000","last_undegraded":"2024-04-25T09:35:11.472267+0000","last_fullsized":"2024-04-25T09:35:11.472267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:10.628308+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:10.628308+0000","last_peered":"2024-04-25T09:35:10.628308+0000","last_clean":"2024-04-25T09:35:10.628308+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:10.628308+0000","last_undegraded":"2024-04-25T09:35:10.628308+0000","last_fullsized":"2024-04-25T09:35:10.628308+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.412471+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:11.412471+0000","last_peered":"2024-04-25T09:35:11.412471+0000","last_clean":"2024-04-25T09:35:11.412471+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:11.412471+0000","last_undegraded":"2024-04-25T09:35:11.412471+0000","last_fullsized":"2024-04-25T09:35:11.412471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"55'7","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.601330+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:11.601330+0000","last_peered":"2024-04-25T09:35:11.601330+0000","last_clean":"2024-04-25T09:35:11.601330+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:11.601330+0000","last_undegraded":"2024-04-25T09:35:11.601330+0000","last_fullsized":"2024-04-25T09:35:11.601330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.470238+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:11.470238+0000","last_peered":"2024-04-25T09:35:11.470238+0000","last_clean":"2024-04-25T09:35:11.470238+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:11.470238+0000","last_undegraded":"2024-04-25T09:35:11.470238+0000","last_fullsized":"2024-04-25T09:35:11.470238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.471658+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:11.471658+0000","last_peered":"2024-04-25T09:35:11.471658+0000","last_clean":"2024-04-25T09:35:11.471658+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:11.471658+0000","last_undegraded":"2024-04-25T09:35:11.471658+0000","last_fullsized":"2024-04-25T09:35:11.471658+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.407879+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:11.407879+0000","last_peered":"2024-04-25T09:35:11.407879+0000","last_clean":"2024-04-25T09:35:11.407879+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:11.407879+0000","last_undegraded":"2024-04-25T09:35:11.407879+0000","last_fullsized":"2024-04-25T09:35:11.407879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"55'1","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:12.436464+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:12.436464+0000","last_peered":"2024-04-25T09:35:12.436464+0000","last_clean":"2024-04-25T09:35:12.436464+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:12.436464+0000","last_undegraded":"2024-04-25T09:35:12.436464+0000","last_fullsized":"2024-04-25T09:35:12.436464+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16384,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":113,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:10.418732+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:10.418732+0000","last_peered":"2024-04-25T09:35:10.418732+0000","last_clean":"2024-04-25T09:35:10.418732+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:10.418732+0000","last_undegraded":"2024-04-25T09:35:10.418732+0000","last_fullsized":"2024-04-25T09:35:10.418732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":761856,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":1507328,"data_compressed":77492,"data_compressed_allocated":753664,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63712,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94308128,"statfs":{"total":96636764160,"available":96571523072,"internally_reserved":0,"allocated":811008,"data_stored":1315007,"data_compressed":58585,"data_compressed_allocated":319488,"data_compressed_original":1130496,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71888,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94299952,"statfs":{"total":96636764160,"available":96563150848,"internally_reserved":0,"allocated":663552,"data_stored":1020095,"data_compressed":43429,"data_compressed_allocated":172032,"data_compressed_original":835584,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75852,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94295988,"statfs":{"total":96636764160,"available":96559091712,"internally_reserved":0,"allocated":462848,"data_stored":164006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80072,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94291768,"statfs":{"total":96636764160,"available":96554770432,"internally_reserved":0,"allocated":524288,"data_stored":754374,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":483328,"data_compressed":24844,"data_compressed_allocated":241664,"data_compressed_original":483328,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":1024000,"data_compressed":52648,"data_compressed_allocated":512000,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:14.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 404 388 1.01033 0.945312 0.113477 0.120588 2024-04-25T09:35:15.056 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:15.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:15.196+0000 7f0a9986d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:15.188 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:15.203+0000 7f0a9986d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:15.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 547 531 1.03702 1.11719 0.16001 0.118426 2024-04-25T09:35:16.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 680 664 1.03741 1.03906 0.102661 0.118636 2024-04-25T09:35:17.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:17.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 820 804 1.04679 1.09375 0.021647 0.118001 2024-04-25T09:35:17.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:17.500+0000 7f7bb3ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:17.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:17.507+0000 7f7bb3ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:18.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 949 933 1.04121 1.00781 0.226313 0.118933 2024-04-25T09:35:19.303 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:19.304 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:19.304 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:19.436 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:19.445+0000 7f570da6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:19.440 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:19.456+0000 7f570da6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:19.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1095 1079 1.05362 1.14062 0.134039 0.117704 2024-04-25T09:35:19.640 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:19.676 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:19.676 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:19.693 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-04-25T09:35:19.322616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6488608,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":857,"num_write_kb":7654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":801,"ondisk_log_size":801,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":282560,"kb_used_data":10080,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377204800,"statfs":{"total":386547056640,"available":386257715200,"internally_reserved":0,"allocated":10321920,"data_stored":18948316,"data_compressed":939901,"data_compressed_allocated":8376320,"data_compressed_original":18227200,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.938435"},"pg_stats":[{"pgid":"7.f","version":"55'63","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.738422+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:16.738422+0000","last_peered":"2024-04-25T09:35:16.738422+0000","last_clean":"2024-04-25T09:35:16.738422+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:16.738422+0000","last_undegraded":"2024-04-25T09:35:16.738422+0000","last_fullsized":"2024-04-25T09:35:16.738422+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"55'23","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:15.785755+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:15.785755+0000","last_peered":"2024-04-25T09:35:15.785755+0000","last_clean":"2024-04-25T09:35:15.785755+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:15.785755+0000","last_undegraded":"2024-04-25T09:35:15.785755+0000","last_fullsized":"2024-04-25T09:35:15.785755+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"55'31","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.432804+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:16.432804+0000","last_peered":"2024-04-25T09:35:16.432804+0000","last_clean":"2024-04-25T09:35:16.432804+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:16.432804+0000","last_undegraded":"2024-04-25T09:35:16.432804+0000","last_fullsized":"2024-04-25T09:35:16.432804+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"55'39","reported_seq":52,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.648281+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:16.648281+0000","last_peered":"2024-04-25T09:35:16.648281+0000","last_clean":"2024-04-25T09:35:16.648281+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:16.648281+0000","last_undegraded":"2024-04-25T09:35:16.648281+0000","last_fullsized":"2024-04-25T09:35:16.648281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"55'95","reported_seq":108,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.998507+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:16.998507+0000","last_peered":"2024-04-25T09:35:16.998507+0000","last_clean":"2024-04-25T09:35:16.998507+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:16.998507+0000","last_undegraded":"2024-04-25T09:35:16.998507+0000","last_fullsized":"2024-04-25T09:35:16.998507+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"55'47","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:15.652888+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:15.652888+0000","last_peered":"2024-04-25T09:35:15.652888+0000","last_clean":"2024-04-25T09:35:15.652888+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:15.652888+0000","last_undegraded":"2024-04-25T09:35:15.652888+0000","last_fullsized":"2024-04-25T09:35:15.652888+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"55'23","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.567386+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:16.567386+0000","last_peered":"2024-04-25T09:35:16.567386+0000","last_clean":"2024-04-25T09:35:16.567386+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:16.567386+0000","last_undegraded":"2024-04-25T09:35:16.567386+0000","last_fullsized":"2024-04-25T09:35:16.567386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"55'47","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:15.900238+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:15.900238+0000","last_peered":"2024-04-25T09:35:15.900238+0000","last_clean":"2024-04-25T09:35:15.900238+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:15.900238+0000","last_undegraded":"2024-04-25T09:35:15.900238+0000","last_fullsized":"2024-04-25T09:35:15.900238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"55'63","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.477192+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:16.477192+0000","last_peered":"2024-04-25T09:35:16.477192+0000","last_clean":"2024-04-25T09:35:16.477192+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:16.477192+0000","last_undegraded":"2024-04-25T09:35:16.477192+0000","last_fullsized":"2024-04-25T09:35:16.477192+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":253,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.463003+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:11.463003+0000","last_peered":"2024-04-25T09:35:11.463003+0000","last_clean":"2024-04-25T09:35:11.463003+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:11.463003+0000","last_undegraded":"2024-04-25T09:35:11.463003+0000","last_fullsized":"2024-04-25T09:35:11.463003+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.472953+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:11.472953+0000","last_peered":"2024-04-25T09:35:11.472953+0000","last_clean":"2024-04-25T09:35:11.472953+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:11.472953+0000","last_undegraded":"2024-04-25T09:35:11.472953+0000","last_fullsized":"2024-04-25T09:35:11.472953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"55'47","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:15.604332+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:15.604332+0000","last_peered":"2024-04-25T09:35:15.604332+0000","last_clean":"2024-04-25T09:35:15.604332+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:15.604332+0000","last_undegraded":"2024-04-25T09:35:15.604332+0000","last_fullsized":"2024-04-25T09:35:15.604332+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.494545+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:11.494545+0000","last_peered":"2024-04-25T09:35:11.494545+0000","last_clean":"2024-04-25T09:35:11.494545+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:11.494545+0000","last_undegraded":"2024-04-25T09:35:11.494545+0000","last_fullsized":"2024-04-25T09:35:11.494545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"55'31","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:15.706692+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:15.706692+0000","last_peered":"2024-04-25T09:35:15.706692+0000","last_clean":"2024-04-25T09:35:15.706692+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:15.706692+0000","last_undegraded":"2024-04-25T09:35:15.706692+0000","last_fullsized":"2024-04-25T09:35:15.706692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.465127+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:11.465127+0000","last_peered":"2024-04-25T09:35:11.465127+0000","last_clean":"2024-04-25T09:35:11.465127+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:11.465127+0000","last_undegraded":"2024-04-25T09:35:11.465127+0000","last_fullsized":"2024-04-25T09:35:11.465127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"55'31","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:15.986264+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:15.986264+0000","last_peered":"2024-04-25T09:35:15.986264+0000","last_clean":"2024-04-25T09:35:15.986264+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:15.986264+0000","last_undegraded":"2024-04-25T09:35:15.986264+0000","last_fullsized":"2024-04-25T09:35:15.986264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.472267+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:11.472267+0000","last_peered":"2024-04-25T09:35:11.472267+0000","last_clean":"2024-04-25T09:35:11.472267+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:11.472267+0000","last_undegraded":"2024-04-25T09:35:11.472267+0000","last_fullsized":"2024-04-25T09:35:11.472267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"55'23","reported_seq":36,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:15.287128+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:15.287128+0000","last_peered":"2024-04-25T09:35:15.287128+0000","last_clean":"2024-04-25T09:35:15.287128+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:15.287128+0000","last_undegraded":"2024-04-25T09:35:15.287128+0000","last_fullsized":"2024-04-25T09:35:15.287128+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.412471+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:11.412471+0000","last_peered":"2024-04-25T09:35:11.412471+0000","last_clean":"2024-04-25T09:35:11.412471+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:11.412471+0000","last_undegraded":"2024-04-25T09:35:11.412471+0000","last_fullsized":"2024-04-25T09:35:11.412471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"55'31","reported_seq":44,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.090493+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:16.090493+0000","last_peered":"2024-04-25T09:35:16.090493+0000","last_clean":"2024-04-25T09:35:16.090493+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:16.090493+0000","last_undegraded":"2024-04-25T09:35:16.090493+0000","last_fullsized":"2024-04-25T09:35:16.090493+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.470238+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:11.470238+0000","last_peered":"2024-04-25T09:35:11.470238+0000","last_clean":"2024-04-25T09:35:11.470238+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:11.470238+0000","last_undegraded":"2024-04-25T09:35:11.470238+0000","last_fullsized":"2024-04-25T09:35:11.470238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"55'55","reported_seq":68,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:17.140994+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:17.140994+0000","last_peered":"2024-04-25T09:35:17.140994+0000","last_clean":"2024-04-25T09:35:17.140994+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:17.140994+0000","last_undegraded":"2024-04-25T09:35:17.140994+0000","last_fullsized":"2024-04-25T09:35:17.140994+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.407879+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:11.407879+0000","last_peered":"2024-04-25T09:35:11.407879+0000","last_clean":"2024-04-25T09:35:11.407879+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:11.407879+0000","last_undegraded":"2024-04-25T09:35:11.407879+0000","last_fullsized":"2024-04-25T09:35:11.407879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"55'55","reported_seq":68,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:16.846266+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:16.846266+0000","last_peered":"2024-04-25T09:35:16.846266+0000","last_clean":"2024-04-25T09:35:16.846266+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:16.846266+0000","last_undegraded":"2024-04-25T09:35:16.846266+0000","last_fullsized":"2024-04-25T09:35:16.846266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.495698+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:11.495698+0000","last_peered":"2024-04-25T09:35:11.495698+0000","last_clean":"2024-04-25T09:35:11.495698+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:11.495698+0000","last_undegraded":"2024-04-25T09:35:11.495698+0000","last_fullsized":"2024-04-25T09:35:11.495698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8933376,"data_stored":17866752,"data_compressed":920052,"data_compressed_allocated":8933376,"data_compressed_original":17866752,"omap_allocated":0,"internal_metadata":0},"log_size":704,"ondisk_log_size":704,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66316,"kb_used_data":3396,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94305524,"statfs":{"total":96636764160,"available":96568856576,"internally_reserved":0,"allocated":3477504,"data_stored":6647999,"data_compressed":333283,"data_compressed_allocated":2985984,"data_compressed_original":6463488,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673414,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73080,"kb_used_data":1840,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94298760,"statfs":{"total":96636764160,"available":96561930240,"internally_reserved":0,"allocated":1884160,"data_stored":3461311,"data_compressed":169173,"data_compressed_allocated":1392640,"data_compressed_original":3276800,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706118,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77856,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94293984,"statfs":{"total":96636764160,"available":96557039616,"internally_reserved":0,"allocated":2514944,"data_stored":4255391,"data_compressed":210468,"data_compressed_allocated":2043904,"data_compressed_original":4087808,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706118,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65308,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94306532,"statfs":{"total":96636764160,"available":96569888768,"internally_reserved":0,"allocated":2445312,"data_stored":4583615,"data_compressed":226977,"data_compressed_allocated":1953792,"data_compressed_original":4399104,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2068480,"data_stored":4136960,"data_compressed":213046,"data_compressed_allocated":2068480,"data_compressed_original":4136960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2228224,"data_stored":4456448,"data_compressed":229458,"data_compressed_allocated":2228224,"data_compressed_original":4456448,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1486848,"data_stored":2973696,"data_compressed":153132,"data_compressed_allocated":1486848,"data_compressed_original":2973696,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3149824,"data_stored":6299648,"data_compressed":324416,"data_compressed_allocated":3149824,"data_compressed_original":6299648,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:19.775 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:19.788+0000 7fd116eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:19.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:19.795+0000 7fd116eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:20.467 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1236 1220 1.05894 1.10156 0.106618 0.117303 2024-04-25T09:35:21.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 1373 1357 1.06006 1.07031 0.036251 0.11697 2024-04-25T09:35:22.085 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:22.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:22.219+0000 7f567df5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:22.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:22.226+0000 7f567df5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:22.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1521 1505 1.0688 1.15625 0.0510338 0.116172 2024-04-25T09:35:23.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1657 1641 1.06826 1.0625 0.115509 0.116379 2024-04-25T09:35:24.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 1806 1790 1.07563 1.16406 0.0496968 0.115804 2024-04-25T09:35:24.508 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:24.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:24.646+0000 7f3b0b86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:24.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:24.653+0000 7f3b0b86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:24.695 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:24.696 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:24.696 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:35:24.696 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:35:24.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:24.843+0000 7f1f7baad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:24.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:24.859+0000 7f1f7baad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:24.880 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:24.881 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:24.881 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:24.883 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:24.883 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:24.884 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:35:25.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:25.045+0000 7f9e090ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:25.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:25.059+0000 7f9e090ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:25.111 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:25.111 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:25.111 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:25.111 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:25.111 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:25.111 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:25.111 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:25.112 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:25.112 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:25.112 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:25.112 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:25.112 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:25.114 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:25.114 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:25.114 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:35:25.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:25.253+0000 7f8ea00ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:25.248 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:25.264+0000 7f8ea00ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:25.266 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:25.266 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:25.267 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:25.274 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:25.274 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:25.274 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:35:25.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:25.425+0000 7f7697217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:25.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:25.437+0000 7f7697217640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:25.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 1946 1930 1.07691 1.09375 0.0833658 0.11551 2024-04-25T09:35:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:25.485 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:25.486 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:25.488 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:25.488 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:26.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2085 2069 1.07751 1.08594 0.0834919 0.115503 2024-04-25T09:35:26.950 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:27.068 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:27.082+0000 7f5ba8c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:27.072 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:27.088+0000 7f5ba8c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:27.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2229 2213 1.08047 1.125 0.0781549 0.115169 2024-04-25T09:35:28.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2375 2359 1.084 1.14062 0.0708373 0.114891 2024-04-25T09:35:29.275 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:29.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:29.410+0000 7fa0af06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:29.400 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:29.416+0000 7fa0af06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:29.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2511 2495 1.0828 1.0625 0.16995 0.114815 2024-04-25T09:35:30.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 2645 2629 1.08091 1.04688 0.0365891 0.115171 2024-04-25T09:35:30.489 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:30.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:35:30.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:30.627+0000 7fb50ef5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:30.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:30.638+0000 7fb50ef5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:31.336 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:35:31.356 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:35:31.468 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:35:31.485596+0000 min lat: 0.0148642 max lat: 0.316748 avg lat: 0.116 2024-04-25T09:35:31.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:35:31.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 2765 2749 1.07373 0.9375 0.036557 0.116 2024-04-25T09:35:31.491 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:31.497+0000 7f7f1902d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:31.496 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:31.511+0000 7f7f1902d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:31.542 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:31.666 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:31.680+0000 7fa3d0b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:31.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:31.687+0000 7fa3d0b1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:32.337 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:35:32.355 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:35:32.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 2905 2889 1.07468 1.09375 0.106509 0.115792 2024-04-25T09:35:32.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:32.507+0000 7fcf7de57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:32.503 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:32.519+0000 7fcf7de57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:33.349 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:35:33.368 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:35:33.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 3047 3031 1.07625 1.10938 0.147638 0.115721 2024-04-25T09:35:33.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:33.508+0000 7feff02ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:33.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:33.521+0000 7feff02ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:33.846 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:33.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:33.982+0000 7fdb69f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:33.973 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:33.988+0000 7fdb69f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:34.350 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:35:34.365 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:35:34.365 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:34.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3170 3154 1.07124 0.960938 0.166477 0.115942 2024-04-25T09:35:34.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:34.512+0000 7f348e02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:34.508 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:34.524+0000 7f348e02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:34.742 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:34.743 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:34.756 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-04-25T09:35:34.367331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23937568,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2987,"num_write_kb":24694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2937,"ondisk_log_size":2937,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":374176,"kb_used_data":35068,"kb_used_omap":0,"kb_used_meta":339072,"kb_avail":377113184,"statfs":{"total":386547056640,"available":386163900416,"internally_reserved":0,"allocated":35909632,"data_stored":70123740,"data_compressed":3581397,"data_compressed_allocated":33964032,"data_compressed_original":69402624,"omap_allocated":0,"internal_metadata":347209728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5562368,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.042608"},"pg_stats":[{"pgid":"7.f","version":"55'240","reported_seq":256,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.399158+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:32.399158+0000","last_peered":"2024-04-25T09:35:32.399158+0000","last_clean":"2024-04-25T09:35:32.399158+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:32.399158+0000","last_undegraded":"2024-04-25T09:35:32.399158+0000","last_fullsized":"2024-04-25T09:35:32.399158+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"55'191","reported_seq":204,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.573394+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:30.573394+0000","last_peered":"2024-04-25T09:35:30.573394+0000","last_clean":"2024-04-25T09:35:30.573394+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:30.573394+0000","last_undegraded":"2024-04-25T09:35:30.573394+0000","last_fullsized":"2024-04-25T09:35:30.573394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"55'167","reported_seq":180,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.016429+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:32.016429+0000","last_peered":"2024-04-25T09:35:32.016429+0000","last_clean":"2024-04-25T09:35:32.016429+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:32.016429+0000","last_undegraded":"2024-04-25T09:35:32.016429+0000","last_fullsized":"2024-04-25T09:35:32.016429+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"55'199","reported_seq":212,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.809887+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:30.809887+0000","last_peered":"2024-04-25T09:35:30.809887+0000","last_clean":"2024-04-25T09:35:30.809887+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:30.809887+0000","last_undegraded":"2024-04-25T09:35:30.809887+0000","last_fullsized":"2024-04-25T09:35:30.809887+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"55'224","reported_seq":240,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.396244+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:32.396244+0000","last_peered":"2024-04-25T09:35:32.396244+0000","last_clean":"2024-04-25T09:35:32.396244+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:32.396244+0000","last_undegraded":"2024-04-25T09:35:32.396244+0000","last_fullsized":"2024-04-25T09:35:32.396244+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"55'144","reported_seq":160,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.389488+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:32.389488+0000","last_peered":"2024-04-25T09:35:32.389488+0000","last_clean":"2024-04-25T09:35:32.389488+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:32.389488+0000","last_undegraded":"2024-04-25T09:35:32.389488+0000","last_fullsized":"2024-04-25T09:35:32.389488+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"55'217","reported_seq":230,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.439065+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:32.439065+0000","last_peered":"2024-04-25T09:35:32.439065+0000","last_clean":"2024-04-25T09:35:32.439065+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:32.439065+0000","last_undegraded":"2024-04-25T09:35:32.439065+0000","last_fullsized":"2024-04-25T09:35:32.439065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785856,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":1744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"55'159","reported_seq":172,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:29.941381+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:29.941381+0000","last_peered":"2024-04-25T09:35:29.941381+0000","last_clean":"2024-04-25T09:35:29.941381+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:29.941381+0000","last_undegraded":"2024-04-25T09:35:29.941381+0000","last_fullsized":"2024-04-25T09:35:29.941381+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"55'240","reported_seq":256,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.385802+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:32.385802+0000","last_peered":"2024-04-25T09:35:32.385802+0000","last_clean":"2024-04-25T09:35:32.385802+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:32.385802+0000","last_undegraded":"2024-04-25T09:35:32.385802+0000","last_fullsized":"2024-04-25T09:35:32.385802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":257,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.392512+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:32.392512+0000","last_peered":"2024-04-25T09:35:32.392512+0000","last_clean":"2024-04-25T09:35:32.392512+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:32.392512+0000","last_undegraded":"2024-04-25T09:35:32.392512+0000","last_fullsized":"2024-04-25T09:35:32.392512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.472953+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:11.472953+0000","last_peered":"2024-04-25T09:35:11.472953+0000","last_clean":"2024-04-25T09:35:11.472953+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:11.472953+0000","last_undegraded":"2024-04-25T09:35:11.472953+0000","last_fullsized":"2024-04-25T09:35:11.472953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"55'111","reported_seq":124,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.492999+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:30.492999+0000","last_peered":"2024-04-25T09:35:30.492999+0000","last_clean":"2024-04-25T09:35:30.492999+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:30.492999+0000","last_undegraded":"2024-04-25T09:35:30.492999+0000","last_fullsized":"2024-04-25T09:35:30.492999+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.382479+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:31.382479+0000","last_peered":"2024-04-25T09:35:31.382479+0000","last_clean":"2024-04-25T09:35:31.382479+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:31.382479+0000","last_undegraded":"2024-04-25T09:35:31.382479+0000","last_fullsized":"2024-04-25T09:35:31.382479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"55'111","reported_seq":124,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.769978+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:31.769978+0000","last_peered":"2024-04-25T09:35:31.769978+0000","last_clean":"2024-04-25T09:35:31.769978+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:31.769978+0000","last_undegraded":"2024-04-25T09:35:31.769978+0000","last_fullsized":"2024-04-25T09:35:31.769978+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.465127+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:11.465127+0000","last_peered":"2024-04-25T09:35:11.465127+0000","last_clean":"2024-04-25T09:35:11.465127+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:11.465127+0000","last_undegraded":"2024-04-25T09:35:11.465127+0000","last_fullsized":"2024-04-25T09:35:11.465127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"55'175","reported_seq":188,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.460142+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:30.460142+0000","last_peered":"2024-04-25T09:35:30.460142+0000","last_clean":"2024-04-25T09:35:30.460142+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:30.460142+0000","last_undegraded":"2024-04-25T09:35:30.460142+0000","last_fullsized":"2024-04-25T09:35:30.460142+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.389954+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:31.389954+0000","last_peered":"2024-04-25T09:35:31.389954+0000","last_clean":"2024-04-25T09:35:31.389954+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:31.389954+0000","last_undegraded":"2024-04-25T09:35:31.389954+0000","last_fullsized":"2024-04-25T09:35:31.389954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"56'159","reported_seq":175,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.425326+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:31.425326+0000","last_peered":"2024-04-25T09:35:31.425326+0000","last_clean":"2024-04-25T09:35:31.425326+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:31.425326+0000","last_undegraded":"2024-04-25T09:35:31.425326+0000","last_fullsized":"2024-04-25T09:35:31.425326+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.412471+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:11.412471+0000","last_peered":"2024-04-25T09:35:11.412471+0000","last_clean":"2024-04-25T09:35:11.412471+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:11.412471+0000","last_undegraded":"2024-04-25T09:35:11.412471+0000","last_fullsized":"2024-04-25T09:35:11.412471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"55'167","reported_seq":180,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.312533+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:32.312533+0000","last_peered":"2024-04-25T09:35:32.312533+0000","last_clean":"2024-04-25T09:35:32.312533+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:32.312533+0000","last_undegraded":"2024-04-25T09:35:32.312533+0000","last_fullsized":"2024-04-25T09:35:32.312533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.395123+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:32.395123+0000","last_peered":"2024-04-25T09:35:32.395123+0000","last_clean":"2024-04-25T09:35:32.395123+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:32.395123+0000","last_undegraded":"2024-04-25T09:35:32.395123+0000","last_fullsized":"2024-04-25T09:35:32.395123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"55'152","reported_seq":168,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.386686+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:32.386686+0000","last_peered":"2024-04-25T09:35:32.386686+0000","last_clean":"2024-04-25T09:35:32.386686+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:32.386686+0000","last_undegraded":"2024-04-25T09:35:32.386686+0000","last_fullsized":"2024-04-25T09:35:32.386686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.407879+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:11.407879+0000","last_peered":"2024-04-25T09:35:11.407879+0000","last_clean":"2024-04-25T09:35:11.407879+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:11.407879+0000","last_undegraded":"2024-04-25T09:35:11.407879+0000","last_fullsized":"2024-04-25T09:35:11.407879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"55'184","reported_seq":200,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.397777+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:32.397777+0000","last_peered":"2024-04-25T09:35:32.397777+0000","last_clean":"2024-04-25T09:35:32.397777+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:32.397777+0000","last_undegraded":"2024-04-25T09:35:32.397777+0000","last_fullsized":"2024-04-25T09:35:32.397777+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.495698+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:11.495698+0000","last_peered":"2024-04-25T09:35:11.495698+0000","last_clean":"2024-04-25T09:35:11.495698+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:11.495698+0000","last_undegraded":"2024-04-25T09:35:11.495698+0000","last_fullsized":"2024-04-25T09:35:11.495698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":23347200,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2850,"num_write_kb":22800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34598912,"data_stored":69197824,"data_compressed":3569751,"data_compressed_allocated":34598912,"data_compressed_original":69197824,"omap_allocated":0,"internal_metadata":0},"log_size":2840,"ondisk_log_size":2840,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100324,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94271516,"statfs":{"total":96636764160,"available":96534032384,"internally_reserved":0,"allocated":11300864,"data_stored":22294719,"data_compressed":1140996,"data_compressed_allocated":10809344,"data_compressed_original":22110208,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81720,"kb_used_data":6320,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94290120,"statfs":{"total":96636764160,"available":96553082880,"internally_reserved":0,"allocated":6471680,"data_stored":12636351,"data_compressed":642783,"data_compressed_allocated":5980160,"data_compressed_original":12451840,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706133,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94808,"kb_used_data":9680,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94277032,"statfs":{"total":96636764160,"available":96539680768,"internally_reserved":0,"allocated":9912320,"data_stored":19050143,"data_compressed":974057,"data_compressed_allocated":9441280,"data_compressed_original":18882560,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706133,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97324,"kb_used_data":8032,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94274516,"statfs":{"total":96636764160,"available":96537104384,"internally_reserved":0,"allocated":8224768,"data_stored":16142527,"data_compressed":823561,"data_compressed_allocated":7733248,"data_compressed_original":15958016,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7888896,"data_stored":15777792,"data_compressed":813898,"data_compressed_allocated":7888896,"data_compressed_original":15777792,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":19243008,"data_compressed":992669,"data_compressed_allocated":9621504,"data_compressed_original":19243008,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6107136,"data_stored":12214272,"data_compressed":630159,"data_compressed_allocated":6107136,"data_compressed_original":12214272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10981376,"data_stored":21962752,"data_compressed":1133025,"data_compressed_allocated":10981376,"data_compressed_original":21962752,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:34.758 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:34.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:34.892+0000 7fd85fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:34.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:34.902+0000 7fd85fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.093 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:35.093 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:35.107 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-04-25T09:35:34.367331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23937568,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2987,"num_write_kb":24694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2937,"ondisk_log_size":2937,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":374176,"kb_used_data":35068,"kb_used_omap":0,"kb_used_meta":339072,"kb_avail":377113184,"statfs":{"total":386547056640,"available":386163900416,"internally_reserved":0,"allocated":35909632,"data_stored":70123740,"data_compressed":3581397,"data_compressed_allocated":33964032,"data_compressed_original":69402624,"omap_allocated":0,"internal_metadata":347209728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5562368,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":5432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.042608"},"pg_stats":[{"pgid":"7.f","version":"55'240","reported_seq":256,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.399158+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:32.399158+0000","last_peered":"2024-04-25T09:35:32.399158+0000","last_clean":"2024-04-25T09:35:32.399158+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:32.399158+0000","last_undegraded":"2024-04-25T09:35:32.399158+0000","last_fullsized":"2024-04-25T09:35:32.399158+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"55'191","reported_seq":204,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.573394+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:30.573394+0000","last_peered":"2024-04-25T09:35:30.573394+0000","last_clean":"2024-04-25T09:35:30.573394+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:30.573394+0000","last_undegraded":"2024-04-25T09:35:30.573394+0000","last_fullsized":"2024-04-25T09:35:30.573394+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"55'167","reported_seq":180,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.016429+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:32.016429+0000","last_peered":"2024-04-25T09:35:32.016429+0000","last_clean":"2024-04-25T09:35:32.016429+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:32.016429+0000","last_undegraded":"2024-04-25T09:35:32.016429+0000","last_fullsized":"2024-04-25T09:35:32.016429+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"55'199","reported_seq":212,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.809887+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:30.809887+0000","last_peered":"2024-04-25T09:35:30.809887+0000","last_clean":"2024-04-25T09:35:30.809887+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:30.809887+0000","last_undegraded":"2024-04-25T09:35:30.809887+0000","last_fullsized":"2024-04-25T09:35:30.809887+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"55'224","reported_seq":240,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.396244+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:32.396244+0000","last_peered":"2024-04-25T09:35:32.396244+0000","last_clean":"2024-04-25T09:35:32.396244+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:32.396244+0000","last_undegraded":"2024-04-25T09:35:32.396244+0000","last_fullsized":"2024-04-25T09:35:32.396244+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"55'144","reported_seq":160,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.389488+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:32.389488+0000","last_peered":"2024-04-25T09:35:32.389488+0000","last_clean":"2024-04-25T09:35:32.389488+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:32.389488+0000","last_undegraded":"2024-04-25T09:35:32.389488+0000","last_fullsized":"2024-04-25T09:35:32.389488+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"55'217","reported_seq":230,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.439065+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:32.439065+0000","last_peered":"2024-04-25T09:35:32.439065+0000","last_clean":"2024-04-25T09:35:32.439065+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:32.439065+0000","last_undegraded":"2024-04-25T09:35:32.439065+0000","last_fullsized":"2024-04-25T09:35:32.439065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785856,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":1744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"55'159","reported_seq":172,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:29.941381+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:29.941381+0000","last_peered":"2024-04-25T09:35:29.941381+0000","last_clean":"2024-04-25T09:35:29.941381+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:29.941381+0000","last_undegraded":"2024-04-25T09:35:29.941381+0000","last_fullsized":"2024-04-25T09:35:29.941381+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"55'240","reported_seq":256,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.385802+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:32.385802+0000","last_peered":"2024-04-25T09:35:32.385802+0000","last_clean":"2024-04-25T09:35:32.385802+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:32.385802+0000","last_undegraded":"2024-04-25T09:35:32.385802+0000","last_fullsized":"2024-04-25T09:35:32.385802+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":257,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.392512+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:32.392512+0000","last_peered":"2024-04-25T09:35:32.392512+0000","last_clean":"2024-04-25T09:35:32.392512+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:32.392512+0000","last_undegraded":"2024-04-25T09:35:32.392512+0000","last_fullsized":"2024-04-25T09:35:32.392512+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.472953+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:11.472953+0000","last_peered":"2024-04-25T09:35:11.472953+0000","last_clean":"2024-04-25T09:35:11.472953+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:11.472953+0000","last_undegraded":"2024-04-25T09:35:11.472953+0000","last_fullsized":"2024-04-25T09:35:11.472953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"55'111","reported_seq":124,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.492999+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:30.492999+0000","last_peered":"2024-04-25T09:35:30.492999+0000","last_clean":"2024-04-25T09:35:30.492999+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:30.492999+0000","last_undegraded":"2024-04-25T09:35:30.492999+0000","last_fullsized":"2024-04-25T09:35:30.492999+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.382479+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:31.382479+0000","last_peered":"2024-04-25T09:35:31.382479+0000","last_clean":"2024-04-25T09:35:31.382479+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:31.382479+0000","last_undegraded":"2024-04-25T09:35:31.382479+0000","last_fullsized":"2024-04-25T09:35:31.382479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"55'111","reported_seq":124,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.769978+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:31.769978+0000","last_peered":"2024-04-25T09:35:31.769978+0000","last_clean":"2024-04-25T09:35:31.769978+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:31.769978+0000","last_undegraded":"2024-04-25T09:35:31.769978+0000","last_fullsized":"2024-04-25T09:35:31.769978+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.465127+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:11.465127+0000","last_peered":"2024-04-25T09:35:11.465127+0000","last_clean":"2024-04-25T09:35:11.465127+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:11.465127+0000","last_undegraded":"2024-04-25T09:35:11.465127+0000","last_fullsized":"2024-04-25T09:35:11.465127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"55'175","reported_seq":188,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:30.460142+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:30.460142+0000","last_peered":"2024-04-25T09:35:30.460142+0000","last_clean":"2024-04-25T09:35:30.460142+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:30.460142+0000","last_undegraded":"2024-04-25T09:35:30.460142+0000","last_fullsized":"2024-04-25T09:35:30.460142+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":117,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.389954+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:31.389954+0000","last_peered":"2024-04-25T09:35:31.389954+0000","last_clean":"2024-04-25T09:35:31.389954+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:31.389954+0000","last_undegraded":"2024-04-25T09:35:31.389954+0000","last_fullsized":"2024-04-25T09:35:31.389954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"56'159","reported_seq":175,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-25T09:35:31.425326+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:31.425326+0000","last_peered":"2024-04-25T09:35:31.425326+0000","last_clean":"2024-04-25T09:35:31.425326+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:31.425326+0000","last_undegraded":"2024-04-25T09:35:31.425326+0000","last_fullsized":"2024-04-25T09:35:31.425326+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.412471+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:11.412471+0000","last_peered":"2024-04-25T09:35:11.412471+0000","last_clean":"2024-04-25T09:35:11.412471+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:11.412471+0000","last_undegraded":"2024-04-25T09:35:11.412471+0000","last_fullsized":"2024-04-25T09:35:11.412471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"55'167","reported_seq":180,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.312533+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:32.312533+0000","last_peered":"2024-04-25T09:35:32.312533+0000","last_clean":"2024-04-25T09:35:32.312533+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:32.312533+0000","last_undegraded":"2024-04-25T09:35:32.312533+0000","last_fullsized":"2024-04-25T09:35:32.312533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.395123+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:32.395123+0000","last_peered":"2024-04-25T09:35:32.395123+0000","last_clean":"2024-04-25T09:35:32.395123+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:32.395123+0000","last_undegraded":"2024-04-25T09:35:32.395123+0000","last_fullsized":"2024-04-25T09:35:32.395123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"55'152","reported_seq":168,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.386686+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:32.386686+0000","last_peered":"2024-04-25T09:35:32.386686+0000","last_clean":"2024-04-25T09:35:32.386686+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:32.386686+0000","last_undegraded":"2024-04-25T09:35:32.386686+0000","last_fullsized":"2024-04-25T09:35:32.386686+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.407879+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:11.407879+0000","last_peered":"2024-04-25T09:35:11.407879+0000","last_clean":"2024-04-25T09:35:11.407879+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:11.407879+0000","last_undegraded":"2024-04-25T09:35:11.407879+0000","last_fullsized":"2024-04-25T09:35:11.407879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"55'184","reported_seq":200,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-04-25T09:35:32.397777+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:32.397777+0000","last_peered":"2024-04-25T09:35:32.397777+0000","last_clean":"2024-04-25T09:35:32.397777+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:32.397777+0000","last_undegraded":"2024-04-25T09:35:32.397777+0000","last_fullsized":"2024-04-25T09:35:32.397777+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":116,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:35:11.495698+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:11.495698+0000","last_peered":"2024-04-25T09:35:11.495698+0000","last_clean":"2024-04-25T09:35:11.495698+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:11.495698+0000","last_undegraded":"2024-04-25T09:35:11.495698+0000","last_fullsized":"2024-04-25T09:35:11.495698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":23347200,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2850,"num_write_kb":22800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34598912,"data_stored":69197824,"data_compressed":3569751,"data_compressed_allocated":34598912,"data_compressed_original":69197824,"omap_allocated":0,"internal_metadata":0},"log_size":2840,"ondisk_log_size":2840,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100324,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94271516,"statfs":{"total":96636764160,"available":96534032384,"internally_reserved":0,"allocated":11300864,"data_stored":22294719,"data_compressed":1140996,"data_compressed_allocated":10809344,"data_compressed_original":22110208,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673429,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81720,"kb_used_data":6320,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94290120,"statfs":{"total":96636764160,"available":96553082880,"internally_reserved":0,"allocated":6471680,"data_stored":12636351,"data_compressed":642783,"data_compressed_allocated":5980160,"data_compressed_original":12451840,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706133,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94808,"kb_used_data":9680,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94277032,"statfs":{"total":96636764160,"available":96539680768,"internally_reserved":0,"allocated":9912320,"data_stored":19050143,"data_compressed":974057,"data_compressed_allocated":9441280,"data_compressed_original":18882560,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706133,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97324,"kb_used_data":8032,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94274516,"statfs":{"total":96636764160,"available":96537104384,"internally_reserved":0,"allocated":8224768,"data_stored":16142527,"data_compressed":823561,"data_compressed_allocated":7733248,"data_compressed_original":15958016,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7888896,"data_stored":15777792,"data_compressed":813898,"data_compressed_allocated":7888896,"data_compressed_original":15777792,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":19243008,"data_compressed":992669,"data_compressed_allocated":9621504,"data_compressed_original":19243008,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6107136,"data_stored":12214272,"data_compressed":630159,"data_compressed_allocated":6107136,"data_compressed_original":12214272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10981376,"data_stored":21962752,"data_compressed":1133025,"data_compressed_allocated":10981376,"data_compressed_original":21962752,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:35.109 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:35:35.110 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:35.110 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:35:35.110 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:35:35.251 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.261+0000 7f3c288ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.270+0000 7f3c288ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:35.285 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:35.288 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:35.289 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:35.289 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:35:35.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.421+0000 7fba1f39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.418 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.434+0000 7fba1f39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3289 3273 1.06533 0.929688 0.13867 0.116973 2024-04-25T09:35:35.523 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:35.523 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:35.523 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:35.523 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:35.523 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:35.524 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:35.524 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:35.524 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:35.524 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:35.524 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:35.524 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:35.524 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:35.527 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:35.527 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:35.528 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:35:35.650 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.660+0000 7ff7176ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.655 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.671+0000 7ff7176ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:35.671 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:35.675 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:35.675 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:35.675 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:35:35.798 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.807+0000 7fa55f39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:35.818+0000 7fa55f39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:35.831 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:35.832 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:35.832 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:35.832 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:35.834 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:35.834 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:36.207 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:36.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:36.335+0000 7f122200f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:36.325 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:36.341+0000 7f122200f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:36.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 3424 3408 1.0649 1.05469 0.0540486 0.116941 2024-04-25T09:35:37.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 3575 3559 1.06931 1.17969 0.164992 0.116593 2024-04-25T09:35:38.469 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 3721 3705 1.07195 1.14062 0.0845068 0.116334 2024-04-25T09:35:38.542 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:38.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:38.687+0000 7feee802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:38.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:38.693+0000 7feee802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:39.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 3854 3838 1.07077 1.03906 0.0833718 0.116489 2024-04-25T09:35:40.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 3983 3967 1.0686 1.00781 0.0907878 0.116529 2024-04-25T09:35:40.836 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:40.836 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:40.836 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:35:40.836 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:35:40.898 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:40.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:40.972+0000 7fe37826d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:40.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:40.983+0000 7fe37826d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:40.989 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:40.989 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:40.989 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:40.989 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:40.989 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:40.990 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:40.990 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:40.990 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:40.990 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:40.990 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:40.990 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:40.990 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:40.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:40.993 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:40.994 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:35:41.028 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.041+0000 7fcd0f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.047+0000 7fcd0f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.143+0000 7fc3e7d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.154+0000 7fc3e7d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.202 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:41.202 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:41.202 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:41.203 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:41.206 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:41.206 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:41.206 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:35:41.389 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.397+0000 7efd424ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.394 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.409+0000 7efd424ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.411 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:41.411 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:41.411 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:41.411 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:41.412 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:41.415 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:41.416 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:41.416 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:35:41.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4112 4096 1.06657 1.00781 0.0784707 0.116877 2024-04-25T09:35:41.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.556+0000 7f9dea46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:41.566+0000 7f9dea46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:35:41.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:35:41.571 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:35:41.571 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:35:41.571 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:35:41.573 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:35:41.573 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:35:42.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4254 4238 1.06795 1.10938 0.0812502 0.116745 2024-04-25T09:35:43.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:43.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 4386 4370 1.0668 1.03125 0.192948 0.11693 2024-04-25T09:35:43.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:43.483+0000 7f54ad15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:43.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:43.489+0000 7f54ad15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:44.470 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 4508 4492 1.06335 0.953125 0.0649374 0.117251 2024-04-25T09:35:45.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 4627 4611 1.05942 0.929688 0.060909 0.117691 2024-04-25T09:35:45.678 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:45.833 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:45.846+0000 7f61684ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:45.837 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:45.852+0000 7f61684ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:46.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 4764 4748 1.05973 1.07031 0.174941 0.117658 2024-04-25T09:35:46.574 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:46.575 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:46.575 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:46.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:46.709+0000 7f70ce824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:46.703 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:46.718+0000 7f70ce824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:46.913 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:46.913 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:46.928 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-04-25T09:35:45.328036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":34906656,"num_objects":527,"num_object_clones":0,"num_object_copies":1581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":4326,"num_write_kb":35406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4270,"ondisk_log_size":4270,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":390472,"kb_used_data":51368,"kb_used_omap":0,"kb_used_meta":339072,"kb_avail":377096888,"statfs":{"total":386547056640,"available":386147213312,"internally_reserved":0,"allocated":52600832,"data_stored":103295916,"data_compressed":5291586,"data_compressed_allocated":50524160,"data_compressed_original":102522880,"omap_allocated":0,"internal_metadata":347209728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10969088,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1339,"num_write_kb":10712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.960705"},"pg_stats":[{"pgid":"7.f","version":"59'287","reported_seq":308,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:37.955331+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:37.955331+0000","last_peered":"2024-04-25T09:35:37.955331+0000","last_clean":"2024-04-25T09:35:37.955331+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:37.955331+0000","last_undegraded":"2024-04-25T09:35:37.955331+0000","last_fullsized":"2024-04-25T09:35:37.955331+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"59'271","reported_seq":290,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:41.376995+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:41.376995+0000","last_peered":"2024-04-25T09:35:41.376995+0000","last_clean":"2024-04-25T09:35:41.376995+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:41.376995+0000","last_undegraded":"2024-04-25T09:35:41.376995+0000","last_fullsized":"2024-04-25T09:35:41.376995+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"59'255","reported_seq":276,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:41.522715+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:41.522715+0000","last_peered":"2024-04-25T09:35:41.522715+0000","last_clean":"2024-04-25T09:35:41.522715+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:41.522715+0000","last_undegraded":"2024-04-25T09:35:41.522715+0000","last_fullsized":"2024-04-25T09:35:41.522715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"59'273","reported_seq":294,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:42.429337+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:42.429337+0000","last_peered":"2024-04-25T09:35:42.429337+0000","last_clean":"2024-04-25T09:35:42.429337+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:42.429337+0000","last_undegraded":"2024-04-25T09:35:42.429337+0000","last_fullsized":"2024-04-25T09:35:42.429337+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244608,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":274,"num_write_kb":2192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"59'319","reported_seq":340,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:42.041305+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:42.041305+0000","last_peered":"2024-04-25T09:35:42.041305+0000","last_clean":"2024-04-25T09:35:42.041305+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:42.041305+0000","last_undegraded":"2024-04-25T09:35:42.041305+0000","last_fullsized":"2024-04-25T09:35:42.041305+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"59'215","reported_seq":236,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:40.034981+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:40.034981+0000","last_peered":"2024-04-25T09:35:40.034981+0000","last_clean":"2024-04-25T09:35:40.034981+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:40.034981+0000","last_undegraded":"2024-04-25T09:35:40.034981+0000","last_fullsized":"2024-04-25T09:35:40.034981+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"59'319","reported_seq":340,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:42.439011+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:42.439011+0000","last_peered":"2024-04-25T09:35:42.439011+0000","last_clean":"2024-04-25T09:35:42.439011+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:42.439011+0000","last_undegraded":"2024-04-25T09:35:42.439011+0000","last_fullsized":"2024-04-25T09:35:42.439011+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"59'255","reported_seq":274,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:40.686732+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:40.686732+0000","last_peered":"2024-04-25T09:35:40.686732+0000","last_clean":"2024-04-25T09:35:40.686732+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:40.686732+0000","last_undegraded":"2024-04-25T09:35:40.686732+0000","last_fullsized":"2024-04-25T09:35:40.686732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"59'335","reported_seq":356,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:41.583563+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:41.583563+0000","last_peered":"2024-04-25T09:35:41.583563+0000","last_clean":"2024-04-25T09:35:41.583563+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:41.583563+0000","last_undegraded":"2024-04-25T09:35:41.583563+0000","last_fullsized":"2024-04-25T09:35:41.583563+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":261,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.536502+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:34.536502+0000","last_peered":"2024-04-25T09:35:34.536502+0000","last_clean":"2024-04-25T09:35:34.536502+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:34.536502+0000","last_undegraded":"2024-04-25T09:35:34.536502+0000","last_fullsized":"2024-04-25T09:35:34.536502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.502314+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:34.502314+0000","last_peered":"2024-04-25T09:35:34.502314+0000","last_clean":"2024-04-25T09:35:34.502314+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:34.502314+0000","last_undegraded":"2024-04-25T09:35:34.502314+0000","last_fullsized":"2024-04-25T09:35:34.502314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"59'223","reported_seq":242,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:41.054724+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:41.054724+0000","last_peered":"2024-04-25T09:35:41.054724+0000","last_clean":"2024-04-25T09:35:41.054724+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:41.054724+0000","last_undegraded":"2024-04-25T09:35:41.054724+0000","last_fullsized":"2024-04-25T09:35:41.054724+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.581846+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:34.581846+0000","last_peered":"2024-04-25T09:35:34.581846+0000","last_clean":"2024-04-25T09:35:34.581846+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:34.581846+0000","last_undegraded":"2024-04-25T09:35:34.581846+0000","last_fullsized":"2024-04-25T09:35:34.581846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"59'191","reported_seq":212,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:42.311519+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:42.311519+0000","last_peered":"2024-04-25T09:35:42.311519+0000","last_clean":"2024-04-25T09:35:42.311519+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:42.311519+0000","last_undegraded":"2024-04-25T09:35:42.311519+0000","last_fullsized":"2024-04-25T09:35:42.311519+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.475550+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:34.475550+0000","last_peered":"2024-04-25T09:35:34.475550+0000","last_clean":"2024-04-25T09:35:34.475550+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:34.475550+0000","last_undegraded":"2024-04-25T09:35:34.475550+0000","last_fullsized":"2024-04-25T09:35:34.475550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"59'258","reported_seq":277,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:41.452736+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:41.452736+0000","last_peered":"2024-04-25T09:35:41.452736+0000","last_clean":"2024-04-25T09:35:41.452736+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:41.452736+0000","last_undegraded":"2024-04-25T09:35:41.452736+0000","last_fullsized":"2024-04-25T09:35:41.452736+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2121728,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":2072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.610640+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:34.610640+0000","last_peered":"2024-04-25T09:35:34.610640+0000","last_clean":"2024-04-25T09:35:34.610640+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:34.610640+0000","last_undegraded":"2024-04-25T09:35:34.610640+0000","last_fullsized":"2024-04-25T09:35:34.610640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"59'223","reported_seq":246,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:39.745008+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:39.745008+0000","last_peered":"2024-04-25T09:35:39.745008+0000","last_clean":"2024-04-25T09:35:39.745008+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:39.745008+0000","last_undegraded":"2024-04-25T09:35:39.745008+0000","last_fullsized":"2024-04-25T09:35:39.745008+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.509202+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:34.509202+0000","last_peered":"2024-04-25T09:35:34.509202+0000","last_clean":"2024-04-25T09:35:34.509202+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:34.509202+0000","last_undegraded":"2024-04-25T09:35:34.509202+0000","last_fullsized":"2024-04-25T09:35:34.509202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"59'223","reported_seq":244,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:42.027724+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:42.027724+0000","last_peered":"2024-04-25T09:35:42.027724+0000","last_clean":"2024-04-25T09:35:42.027724+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:42.027724+0000","last_undegraded":"2024-04-25T09:35:42.027724+0000","last_fullsized":"2024-04-25T09:35:42.027724+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.534732+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:34.534732+0000","last_peered":"2024-04-25T09:35:34.534732+0000","last_clean":"2024-04-25T09:35:34.534732+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:34.534732+0000","last_undegraded":"2024-04-25T09:35:34.534732+0000","last_fullsized":"2024-04-25T09:35:34.534732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"59'239","reported_seq":260,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:40.427984+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:40.427984+0000","last_peered":"2024-04-25T09:35:40.427984+0000","last_clean":"2024-04-25T09:35:40.427984+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:40.427984+0000","last_undegraded":"2024-04-25T09:35:40.427984+0000","last_fullsized":"2024-04-25T09:35:40.427984+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.517776+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:34.517776+0000","last_peered":"2024-04-25T09:35:34.517776+0000","last_clean":"2024-04-25T09:35:34.517776+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:34.517776+0000","last_undegraded":"2024-04-25T09:35:34.517776+0000","last_fullsized":"2024-04-25T09:35:34.517776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"59'287","reported_seq":308,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:41.892865+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:41.892865+0000","last_peered":"2024-04-25T09:35:41.892865+0000","last_clean":"2024-04-25T09:35:41.892865+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:41.892865+0000","last_undegraded":"2024-04-25T09:35:41.892865+0000","last_fullsized":"2024-04-25T09:35:41.892865+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.495772+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:34.495772+0000","last_peered":"2024-04-25T09:35:34.495772+0000","last_clean":"2024-04-25T09:35:34.495772+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:34.495772+0000","last_undegraded":"2024-04-25T09:35:34.495772+0000","last_fullsized":"2024-04-25T09:35:34.495772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":34316288,"num_objects":525,"num_object_clones":0,"num_object_copies":1575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4189,"num_write_kb":33512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51257344,"data_stored":102514688,"data_compressed":5290092,"data_compressed_allocated":51257344,"data_compressed_original":102514688,"omap_allocated":0,"internal_metadata":0},"log_size":4173,"ondisk_log_size":4173,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113756,"kb_used_data":16148,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94258084,"statfs":{"total":96636764160,"available":96520278016,"internally_reserved":0,"allocated":16535552,"data_stored":32711539,"data_compressed":1678206,"data_compressed_allocated":16011264,"data_compressed_original":32514048,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673439,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72252,"kb_used_data":9332,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94299588,"statfs":{"total":96636764160,"available":96562778112,"internally_reserved":0,"allocated":9555968,"data_stored":18752371,"data_compressed":957918,"data_compressed_allocated":9031680,"data_compressed_original":18554880,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103464,"kb_used_data":14176,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94268376,"statfs":{"total":96636764160,"available":96530817024,"internally_reserved":0,"allocated":14516224,"data_stored":28205395,"data_compressed":1446125,"data_compressed_allocated":14012416,"data_compressed_original":28024832,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101000,"kb_used_data":11712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94270840,"statfs":{"total":96636764160,"available":96533340160,"internally_reserved":0,"allocated":11993088,"data_stored":23626611,"data_compressed":1209337,"data_compressed_allocated":11468800,"data_compressed_original":23429120,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11624448,"data_stored":23248896,"data_compressed":1199674,"data_compressed_allocated":11624448,"data_compressed_original":23248896,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14233600,"data_stored":28467200,"data_compressed":1468967,"data_compressed_allocated":14233600,"data_compressed_original":28467200,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9236480,"data_stored":18472960,"data_compressed":953331,"data_compressed_allocated":9236480,"data_compressed_original":18472960,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16162816,"data_stored":32325632,"data_compressed":1668120,"data_compressed_allocated":16162816,"data_compressed_original":32325632,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:47.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 4899 4883 1.05958 1.05469 0.154781 0.117764 2024-04-25T09:35:48.021 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:48.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:48.152+0000 7f28ab31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:48.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:48.159+0000 7f28ab31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:48.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5021 5005 1.0567 0.953125 0.0200051 0.118019 2024-04-25T09:35:49.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5155 5139 1.05644 1.04688 0.188752 0.118009 2024-04-25T09:35:50.298 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:50.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:50.435+0000 7f8348c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:50.426 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:50.441+0000 7f8348c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:50.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 5301 5285 1.0586 1.14062 0.155723 0.117822 2024-04-25T09:35:51.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:35:51.487487+0000 min lat: 0.0148642 max lat: 0.364704 avg lat: 0.117892 2024-04-25T09:35:51.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:35:51.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 5434 5418 1.05811 1.03906 0.0534318 0.117892 2024-04-25T09:35:51.931 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:35:51.931 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:35:52.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:52.072+0000 7fa23506d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:52.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:52.084+0000 7fa23506d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:52.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 5570 5554 1.05821 1.0625 0.131414 0.117955 2024-04-25T09:35:52.490 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:35:52.507 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:35:52.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:52.636+0000 7fc0e982d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:52.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:52.647+0000 7fc0e982d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:52.763 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:52.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:52.896+0000 7fe22ab1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:52.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:52.902+0000 7fe22ab1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:53.471 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 5677 5661 1.05292 0.835938 0.0205494 0.118381 2024-04-25T09:35:53.494 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:35:53.512 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:35:53.635 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:53.643+0000 7f833182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:53.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:53.654+0000 7f833182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:54.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 5797 5781 1.05023 0.9375 0.0701897 0.118795 2024-04-25T09:35:54.499 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:35:54.515 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:35:54.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:54.658+0000 7fd5734ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:54.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:54.671+0000 7fd5734ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:55.121 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:55.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:55.271+0000 7f02cbd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:55.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:55.277+0000 7f02cbd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:55.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 5922 5906 1.04855 0.976562 0.142332 0.119017 2024-04-25T09:35:55.504 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:35:55.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:35:55.527 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:55.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:55.704+0000 7fa31635d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:55.701 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:55.716+0000 7fa31635d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:55.916 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:55.917 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:55.931 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-04-25T09:35:55.521175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45548064,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5625,"num_write_kb":45798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5569,"ondisk_log_size":5569,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":424352,"kb_used_data":67192,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":377063008,"statfs":{"total":386547056640,"available":386112520192,"internally_reserved":0,"allocated":68804608,"data_stored":135703468,"data_compressed":6964974,"data_compressed_allocated":66727936,"data_compressed_original":134930432,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5144576,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":5024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.191906"},"pg_stats":[{"pgid":"7.f","version":"59'391","reported_seq":412,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.256701+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:52.256701+0000","last_peered":"2024-04-25T09:35:52.256701+0000","last_clean":"2024-04-25T09:35:52.256701+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:52.256701+0000","last_undegraded":"2024-04-25T09:35:52.256701+0000","last_fullsized":"2024-04-25T09:35:52.256701+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"59'375","reported_seq":394,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.405265+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:51.405265+0000","last_peered":"2024-04-25T09:35:51.405265+0000","last_clean":"2024-04-25T09:35:51.405265+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:51.405265+0000","last_undegraded":"2024-04-25T09:35:51.405265+0000","last_fullsized":"2024-04-25T09:35:51.405265+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"59'311","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.392761+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:52.392761+0000","last_peered":"2024-04-25T09:35:52.392761+0000","last_clean":"2024-04-25T09:35:52.392761+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:52.392761+0000","last_undegraded":"2024-04-25T09:35:52.392761+0000","last_fullsized":"2024-04-25T09:35:52.392761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"59'375","reported_seq":396,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.241234+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:52.241234+0000","last_peered":"2024-04-25T09:35:52.241234+0000","last_clean":"2024-04-25T09:35:52.241234+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:52.241234+0000","last_undegraded":"2024-04-25T09:35:52.241234+0000","last_fullsized":"2024-04-25T09:35:52.241234+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"59'407","reported_seq":428,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:47.079820+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:47.079820+0000","last_peered":"2024-04-25T09:35:47.079820+0000","last_clean":"2024-04-25T09:35:47.079820+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:47.079820+0000","last_undegraded":"2024-04-25T09:35:47.079820+0000","last_fullsized":"2024-04-25T09:35:47.079820+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"59'287","reported_seq":308,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.218732+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:50.218732+0000","last_peered":"2024-04-25T09:35:50.218732+0000","last_clean":"2024-04-25T09:35:50.218732+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:50.218732+0000","last_undegraded":"2024-04-25T09:35:50.218732+0000","last_fullsized":"2024-04-25T09:35:50.218732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"59'399","reported_seq":420,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:49.985526+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:49.985526+0000","last_peered":"2024-04-25T09:35:49.985526+0000","last_clean":"2024-04-25T09:35:49.985526+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:49.985526+0000","last_undegraded":"2024-04-25T09:35:49.985526+0000","last_fullsized":"2024-04-25T09:35:49.985526+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"59'303","reported_seq":322,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:49.849362+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:49.849362+0000","last_peered":"2024-04-25T09:35:49.849362+0000","last_clean":"2024-04-25T09:35:49.849362+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:49.849362+0000","last_undegraded":"2024-04-25T09:35:49.849362+0000","last_fullsized":"2024-04-25T09:35:49.849362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"59'439","reported_seq":460,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.561483+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:51.561483+0000","last_peered":"2024-04-25T09:35:51.561483+0000","last_clean":"2024-04-25T09:35:51.561483+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:51.561483+0000","last_undegraded":"2024-04-25T09:35:51.561483+0000","last_fullsized":"2024-04-25T09:35:51.561483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":261,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.536502+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:34.536502+0000","last_peered":"2024-04-25T09:35:34.536502+0000","last_clean":"2024-04-25T09:35:34.536502+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:34.536502+0000","last_undegraded":"2024-04-25T09:35:34.536502+0000","last_fullsized":"2024-04-25T09:35:34.536502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.502314+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:34.502314+0000","last_peered":"2024-04-25T09:35:34.502314+0000","last_clean":"2024-04-25T09:35:34.502314+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:34.502314+0000","last_undegraded":"2024-04-25T09:35:34.502314+0000","last_fullsized":"2024-04-25T09:35:34.502314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"59'313","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.417534+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:51.417534+0000","last_peered":"2024-04-25T09:35:51.417534+0000","last_clean":"2024-04-25T09:35:51.417534+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:51.417534+0000","last_undegraded":"2024-04-25T09:35:51.417534+0000","last_fullsized":"2024-04-25T09:35:51.417534+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2572288,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":2512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.581846+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:34.581846+0000","last_peered":"2024-04-25T09:35:34.581846+0000","last_clean":"2024-04-25T09:35:34.581846+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:34.581846+0000","last_undegraded":"2024-04-25T09:35:34.581846+0000","last_fullsized":"2024-04-25T09:35:34.581846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"59'293","reported_seq":314,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.439520+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:52.439520+0000","last_peered":"2024-04-25T09:35:52.439520+0000","last_clean":"2024-04-25T09:35:52.439520+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:52.439520+0000","last_undegraded":"2024-04-25T09:35:52.439520+0000","last_fullsized":"2024-04-25T09:35:52.439520+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2408448,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":2352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.475550+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:34.475550+0000","last_peered":"2024-04-25T09:35:34.475550+0000","last_clean":"2024-04-25T09:35:34.475550+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:34.475550+0000","last_undegraded":"2024-04-25T09:35:34.475550+0000","last_fullsized":"2024-04-25T09:35:34.475550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"59'335","reported_seq":354,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.322468+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:50.322468+0000","last_peered":"2024-04-25T09:35:50.322468+0000","last_clean":"2024-04-25T09:35:50.322468+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:50.322468+0000","last_undegraded":"2024-04-25T09:35:50.322468+0000","last_fullsized":"2024-04-25T09:35:50.322468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.610640+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:34.610640+0000","last_peered":"2024-04-25T09:35:34.610640+0000","last_clean":"2024-04-25T09:35:34.610640+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:34.610640+0000","last_undegraded":"2024-04-25T09:35:34.610640+0000","last_fullsized":"2024-04-25T09:35:34.610640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"59'271","reported_seq":294,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.992355+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:50.992355+0000","last_peered":"2024-04-25T09:35:50.992355+0000","last_clean":"2024-04-25T09:35:50.992355+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:50.992355+0000","last_undegraded":"2024-04-25T09:35:50.992355+0000","last_fullsized":"2024-04-25T09:35:50.992355+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.509202+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:34.509202+0000","last_peered":"2024-04-25T09:35:34.509202+0000","last_clean":"2024-04-25T09:35:34.509202+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:34.509202+0000","last_undegraded":"2024-04-25T09:35:34.509202+0000","last_fullsized":"2024-04-25T09:35:34.509202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"59'295","reported_seq":316,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.514065+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:50.514065+0000","last_peered":"2024-04-25T09:35:50.514065+0000","last_clean":"2024-04-25T09:35:50.514065+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:50.514065+0000","last_undegraded":"2024-04-25T09:35:50.514065+0000","last_fullsized":"2024-04-25T09:35:50.514065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.534732+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:34.534732+0000","last_peered":"2024-04-25T09:35:34.534732+0000","last_clean":"2024-04-25T09:35:34.534732+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:34.534732+0000","last_undegraded":"2024-04-25T09:35:34.534732+0000","last_fullsized":"2024-04-25T09:35:34.534732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"59'311","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.423318+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:52.423318+0000","last_peered":"2024-04-25T09:35:52.423318+0000","last_clean":"2024-04-25T09:35:52.423318+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:52.423318+0000","last_undegraded":"2024-04-25T09:35:52.423318+0000","last_fullsized":"2024-04-25T09:35:52.423318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.517776+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:34.517776+0000","last_peered":"2024-04-25T09:35:34.517776+0000","last_clean":"2024-04-25T09:35:34.517776+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:34.517776+0000","last_undegraded":"2024-04-25T09:35:34.517776+0000","last_fullsized":"2024-04-25T09:35:34.517776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"59'367","reported_seq":388,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.347725+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:51.347725+0000","last_peered":"2024-04-25T09:35:51.347725+0000","last_clean":"2024-04-25T09:35:51.347725+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:51.347725+0000","last_undegraded":"2024-04-25T09:35:51.347725+0000","last_fullsized":"2024-04-25T09:35:51.347725+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.495772+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:34.495772+0000","last_peered":"2024-04-25T09:35:34.495772+0000","last_clean":"2024-04-25T09:35:34.495772+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:34.495772+0000","last_undegraded":"2024-04-25T09:35:34.495772+0000","last_fullsized":"2024-04-25T09:35:34.495772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":44957696,"num_objects":687,"num_object_clones":0,"num_object_copies":2061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5488,"num_write_kb":43904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67424256,"data_stored":134848512,"data_compressed":6959673,"data_compressed_allocated":67424256,"data_compressed_original":134848512,"omap_allocated":0,"internal_metadata":0},"log_size":5472,"ondisk_log_size":5472,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106152,"kb_used_data":21020,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94265688,"statfs":{"total":96636764160,"available":96528064512,"internally_reserved":0,"allocated":21524480,"data_stored":42689395,"data_compressed":2193420,"data_compressed_allocated":21000192,"data_compressed_original":42491904,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97476,"kb_used_data":12348,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94274364,"statfs":{"total":96636764160,"available":96536948736,"internally_reserved":0,"allocated":12644352,"data_stored":24929139,"data_compressed":1276860,"data_compressed_allocated":12120064,"data_compressed_original":24731648,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111932,"kb_used_data":18484,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94259908,"statfs":{"total":96636764160,"available":96522145792,"internally_reserved":0,"allocated":18927616,"data_stored":37028179,"data_compressed":1901696,"data_compressed_allocated":18423808,"data_compressed_original":36847616,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108792,"kb_used_data":15340,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94263048,"statfs":{"total":96636764160,"available":96525361152,"internally_reserved":0,"allocated":15708160,"data_stored":31056755,"data_compressed":1592998,"data_compressed_allocated":15183872,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15310848,"data_stored":30621696,"data_compressed":1580374,"data_compressed_allocated":15310848,"data_compressed_original":30621696,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18657280,"data_stored":37314560,"data_compressed":1925807,"data_compressed_allocated":18657280,"data_compressed_original":37314560,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12279808,"data_stored":24559616,"data_compressed":1267620,"data_compressed_allocated":12279808,"data_compressed_original":24559616,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21176320,"data_stored":42352640,"data_compressed":2185872,"data_compressed_allocated":21176320,"data_compressed_original":42352640,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:55.932 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:56.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:56.067+0000 7fc0e0e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:56.061 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:56.076+0000 7fc0e0e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:56.265 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:56.265 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:56.279 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-04-25T09:35:55.521175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45548064,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5625,"num_write_kb":45798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5569,"ondisk_log_size":5569,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":424352,"kb_used_data":67192,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":377063008,"statfs":{"total":386547056640,"available":386112520192,"internally_reserved":0,"allocated":68804608,"data_stored":135703468,"data_compressed":6964974,"data_compressed_allocated":66727936,"data_compressed_original":134930432,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5144576,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":5024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.191906"},"pg_stats":[{"pgid":"7.f","version":"59'391","reported_seq":412,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.256701+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:52.256701+0000","last_peered":"2024-04-25T09:35:52.256701+0000","last_clean":"2024-04-25T09:35:52.256701+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:52.256701+0000","last_undegraded":"2024-04-25T09:35:52.256701+0000","last_fullsized":"2024-04-25T09:35:52.256701+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"59'375","reported_seq":394,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.405265+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:51.405265+0000","last_peered":"2024-04-25T09:35:51.405265+0000","last_clean":"2024-04-25T09:35:51.405265+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:51.405265+0000","last_undegraded":"2024-04-25T09:35:51.405265+0000","last_fullsized":"2024-04-25T09:35:51.405265+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"59'311","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.392761+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:52.392761+0000","last_peered":"2024-04-25T09:35:52.392761+0000","last_clean":"2024-04-25T09:35:52.392761+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:52.392761+0000","last_undegraded":"2024-04-25T09:35:52.392761+0000","last_fullsized":"2024-04-25T09:35:52.392761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"59'375","reported_seq":396,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.241234+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:52.241234+0000","last_peered":"2024-04-25T09:35:52.241234+0000","last_clean":"2024-04-25T09:35:52.241234+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:52.241234+0000","last_undegraded":"2024-04-25T09:35:52.241234+0000","last_fullsized":"2024-04-25T09:35:52.241234+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"59'407","reported_seq":428,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:47.079820+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:47.079820+0000","last_peered":"2024-04-25T09:35:47.079820+0000","last_clean":"2024-04-25T09:35:47.079820+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:47.079820+0000","last_undegraded":"2024-04-25T09:35:47.079820+0000","last_fullsized":"2024-04-25T09:35:47.079820+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"59'287","reported_seq":308,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.218732+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:50.218732+0000","last_peered":"2024-04-25T09:35:50.218732+0000","last_clean":"2024-04-25T09:35:50.218732+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:50.218732+0000","last_undegraded":"2024-04-25T09:35:50.218732+0000","last_fullsized":"2024-04-25T09:35:50.218732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"59'399","reported_seq":420,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:49.985526+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:49.985526+0000","last_peered":"2024-04-25T09:35:49.985526+0000","last_clean":"2024-04-25T09:35:49.985526+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:49.985526+0000","last_undegraded":"2024-04-25T09:35:49.985526+0000","last_fullsized":"2024-04-25T09:35:49.985526+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"59'303","reported_seq":322,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:49.849362+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:49.849362+0000","last_peered":"2024-04-25T09:35:49.849362+0000","last_clean":"2024-04-25T09:35:49.849362+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:49.849362+0000","last_undegraded":"2024-04-25T09:35:49.849362+0000","last_fullsized":"2024-04-25T09:35:49.849362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"59'439","reported_seq":460,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.561483+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:51.561483+0000","last_peered":"2024-04-25T09:35:51.561483+0000","last_clean":"2024-04-25T09:35:51.561483+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:51.561483+0000","last_undegraded":"2024-04-25T09:35:51.561483+0000","last_fullsized":"2024-04-25T09:35:51.561483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":261,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.536502+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:34.536502+0000","last_peered":"2024-04-25T09:35:34.536502+0000","last_clean":"2024-04-25T09:35:34.536502+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:34.536502+0000","last_undegraded":"2024-04-25T09:35:34.536502+0000","last_fullsized":"2024-04-25T09:35:34.536502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.502314+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:34.502314+0000","last_peered":"2024-04-25T09:35:34.502314+0000","last_clean":"2024-04-25T09:35:34.502314+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:34.502314+0000","last_undegraded":"2024-04-25T09:35:34.502314+0000","last_fullsized":"2024-04-25T09:35:34.502314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"59'313","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.417534+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:51.417534+0000","last_peered":"2024-04-25T09:35:51.417534+0000","last_clean":"2024-04-25T09:35:51.417534+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:51.417534+0000","last_undegraded":"2024-04-25T09:35:51.417534+0000","last_fullsized":"2024-04-25T09:35:51.417534+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2572288,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":2512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.581846+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:34.581846+0000","last_peered":"2024-04-25T09:35:34.581846+0000","last_clean":"2024-04-25T09:35:34.581846+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:34.581846+0000","last_undegraded":"2024-04-25T09:35:34.581846+0000","last_fullsized":"2024-04-25T09:35:34.581846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"59'293","reported_seq":314,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.439520+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:52.439520+0000","last_peered":"2024-04-25T09:35:52.439520+0000","last_clean":"2024-04-25T09:35:52.439520+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:52.439520+0000","last_undegraded":"2024-04-25T09:35:52.439520+0000","last_fullsized":"2024-04-25T09:35:52.439520+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2408448,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":2352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.475550+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:34.475550+0000","last_peered":"2024-04-25T09:35:34.475550+0000","last_clean":"2024-04-25T09:35:34.475550+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:34.475550+0000","last_undegraded":"2024-04-25T09:35:34.475550+0000","last_fullsized":"2024-04-25T09:35:34.475550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"59'335","reported_seq":354,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.322468+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:50.322468+0000","last_peered":"2024-04-25T09:35:50.322468+0000","last_clean":"2024-04-25T09:35:50.322468+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:50.322468+0000","last_undegraded":"2024-04-25T09:35:50.322468+0000","last_fullsized":"2024-04-25T09:35:50.322468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.610640+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:34.610640+0000","last_peered":"2024-04-25T09:35:34.610640+0000","last_clean":"2024-04-25T09:35:34.610640+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:34.610640+0000","last_undegraded":"2024-04-25T09:35:34.610640+0000","last_fullsized":"2024-04-25T09:35:34.610640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"59'271","reported_seq":294,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.992355+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:50.992355+0000","last_peered":"2024-04-25T09:35:50.992355+0000","last_clean":"2024-04-25T09:35:50.992355+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:50.992355+0000","last_undegraded":"2024-04-25T09:35:50.992355+0000","last_fullsized":"2024-04-25T09:35:50.992355+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.509202+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:34.509202+0000","last_peered":"2024-04-25T09:35:34.509202+0000","last_clean":"2024-04-25T09:35:34.509202+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:34.509202+0000","last_undegraded":"2024-04-25T09:35:34.509202+0000","last_fullsized":"2024-04-25T09:35:34.509202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"59'295","reported_seq":316,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.514065+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:50.514065+0000","last_peered":"2024-04-25T09:35:50.514065+0000","last_clean":"2024-04-25T09:35:50.514065+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:50.514065+0000","last_undegraded":"2024-04-25T09:35:50.514065+0000","last_fullsized":"2024-04-25T09:35:50.514065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.534732+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:34.534732+0000","last_peered":"2024-04-25T09:35:34.534732+0000","last_clean":"2024-04-25T09:35:34.534732+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:34.534732+0000","last_undegraded":"2024-04-25T09:35:34.534732+0000","last_fullsized":"2024-04-25T09:35:34.534732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"59'311","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.423318+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:52.423318+0000","last_peered":"2024-04-25T09:35:52.423318+0000","last_clean":"2024-04-25T09:35:52.423318+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:52.423318+0000","last_undegraded":"2024-04-25T09:35:52.423318+0000","last_fullsized":"2024-04-25T09:35:52.423318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.517776+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:34.517776+0000","last_peered":"2024-04-25T09:35:34.517776+0000","last_clean":"2024-04-25T09:35:34.517776+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:34.517776+0000","last_undegraded":"2024-04-25T09:35:34.517776+0000","last_fullsized":"2024-04-25T09:35:34.517776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"59'367","reported_seq":388,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.347725+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:51.347725+0000","last_peered":"2024-04-25T09:35:51.347725+0000","last_clean":"2024-04-25T09:35:51.347725+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:51.347725+0000","last_undegraded":"2024-04-25T09:35:51.347725+0000","last_fullsized":"2024-04-25T09:35:51.347725+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.495772+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:34.495772+0000","last_peered":"2024-04-25T09:35:34.495772+0000","last_clean":"2024-04-25T09:35:34.495772+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:34.495772+0000","last_undegraded":"2024-04-25T09:35:34.495772+0000","last_fullsized":"2024-04-25T09:35:34.495772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":44957696,"num_objects":687,"num_object_clones":0,"num_object_copies":2061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5488,"num_write_kb":43904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67424256,"data_stored":134848512,"data_compressed":6959673,"data_compressed_allocated":67424256,"data_compressed_original":134848512,"omap_allocated":0,"internal_metadata":0},"log_size":5472,"ondisk_log_size":5472,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106152,"kb_used_data":21020,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94265688,"statfs":{"total":96636764160,"available":96528064512,"internally_reserved":0,"allocated":21524480,"data_stored":42689395,"data_compressed":2193420,"data_compressed_allocated":21000192,"data_compressed_original":42491904,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97476,"kb_used_data":12348,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94274364,"statfs":{"total":96636764160,"available":96536948736,"internally_reserved":0,"allocated":12644352,"data_stored":24929139,"data_compressed":1276860,"data_compressed_allocated":12120064,"data_compressed_original":24731648,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111932,"kb_used_data":18484,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94259908,"statfs":{"total":96636764160,"available":96522145792,"internally_reserved":0,"allocated":18927616,"data_stored":37028179,"data_compressed":1901696,"data_compressed_allocated":18423808,"data_compressed_original":36847616,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108792,"kb_used_data":15340,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94263048,"statfs":{"total":96636764160,"available":96525361152,"internally_reserved":0,"allocated":15708160,"data_stored":31056755,"data_compressed":1592998,"data_compressed_allocated":15183872,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15310848,"data_stored":30621696,"data_compressed":1580374,"data_compressed_allocated":15310848,"data_compressed_original":30621696,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18657280,"data_stored":37314560,"data_compressed":1925807,"data_compressed_allocated":18657280,"data_compressed_original":37314560,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12279808,"data_stored":24559616,"data_compressed":1267620,"data_compressed_allocated":12279808,"data_compressed_original":24559616,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21176320,"data_stored":42352640,"data_compressed":2185872,"data_compressed_allocated":21176320,"data_compressed_original":42352640,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:56.280 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:35:56.280 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:35:56.281 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:35:56.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:56.416+0000 7f859a35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:56.410 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:56.425+0000 7f859a35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:56.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 6048 6032 1.04713 0.984375 0.112611 0.119164 2024-04-25T09:35:56.621 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:35:56.621 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:35:56.636 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-04-25T09:35:55.521175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45548064,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5625,"num_write_kb":45798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5569,"ondisk_log_size":5569,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":424352,"kb_used_data":67192,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":377063008,"statfs":{"total":386547056640,"available":386112520192,"internally_reserved":0,"allocated":68804608,"data_stored":135703468,"data_compressed":6964974,"data_compressed_allocated":66727936,"data_compressed_original":134930432,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5144576,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":5024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.191906"},"pg_stats":[{"pgid":"7.f","version":"59'391","reported_seq":412,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.256701+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:52.256701+0000","last_peered":"2024-04-25T09:35:52.256701+0000","last_clean":"2024-04-25T09:35:52.256701+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:52.256701+0000","last_undegraded":"2024-04-25T09:35:52.256701+0000","last_fullsized":"2024-04-25T09:35:52.256701+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"59'375","reported_seq":394,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.405265+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:51.405265+0000","last_peered":"2024-04-25T09:35:51.405265+0000","last_clean":"2024-04-25T09:35:51.405265+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:51.405265+0000","last_undegraded":"2024-04-25T09:35:51.405265+0000","last_fullsized":"2024-04-25T09:35:51.405265+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"59'311","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.392761+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:52.392761+0000","last_peered":"2024-04-25T09:35:52.392761+0000","last_clean":"2024-04-25T09:35:52.392761+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:52.392761+0000","last_undegraded":"2024-04-25T09:35:52.392761+0000","last_fullsized":"2024-04-25T09:35:52.392761+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"59'375","reported_seq":396,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.241234+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:52.241234+0000","last_peered":"2024-04-25T09:35:52.241234+0000","last_clean":"2024-04-25T09:35:52.241234+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:52.241234+0000","last_undegraded":"2024-04-25T09:35:52.241234+0000","last_fullsized":"2024-04-25T09:35:52.241234+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"59'407","reported_seq":428,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:47.079820+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:47.079820+0000","last_peered":"2024-04-25T09:35:47.079820+0000","last_clean":"2024-04-25T09:35:47.079820+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:47.079820+0000","last_undegraded":"2024-04-25T09:35:47.079820+0000","last_fullsized":"2024-04-25T09:35:47.079820+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"59'287","reported_seq":308,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.218732+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:50.218732+0000","last_peered":"2024-04-25T09:35:50.218732+0000","last_clean":"2024-04-25T09:35:50.218732+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:50.218732+0000","last_undegraded":"2024-04-25T09:35:50.218732+0000","last_fullsized":"2024-04-25T09:35:50.218732+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"59'399","reported_seq":420,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:49.985526+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:49.985526+0000","last_peered":"2024-04-25T09:35:49.985526+0000","last_clean":"2024-04-25T09:35:49.985526+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:49.985526+0000","last_undegraded":"2024-04-25T09:35:49.985526+0000","last_fullsized":"2024-04-25T09:35:49.985526+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"59'303","reported_seq":322,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:49.849362+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:49.849362+0000","last_peered":"2024-04-25T09:35:49.849362+0000","last_clean":"2024-04-25T09:35:49.849362+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:49.849362+0000","last_undegraded":"2024-04-25T09:35:49.849362+0000","last_fullsized":"2024-04-25T09:35:49.849362+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"59'439","reported_seq":460,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.561483+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:51.561483+0000","last_peered":"2024-04-25T09:35:51.561483+0000","last_clean":"2024-04-25T09:35:51.561483+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:51.561483+0000","last_undegraded":"2024-04-25T09:35:51.561483+0000","last_fullsized":"2024-04-25T09:35:51.561483+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":261,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.536502+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:34.536502+0000","last_peered":"2024-04-25T09:35:34.536502+0000","last_clean":"2024-04-25T09:35:34.536502+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:34.536502+0000","last_undegraded":"2024-04-25T09:35:34.536502+0000","last_fullsized":"2024-04-25T09:35:34.536502+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.502314+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:34.502314+0000","last_peered":"2024-04-25T09:35:34.502314+0000","last_clean":"2024-04-25T09:35:34.502314+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:34.502314+0000","last_undegraded":"2024-04-25T09:35:34.502314+0000","last_fullsized":"2024-04-25T09:35:34.502314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"59'313","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.417534+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:51.417534+0000","last_peered":"2024-04-25T09:35:51.417534+0000","last_clean":"2024-04-25T09:35:51.417534+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:51.417534+0000","last_undegraded":"2024-04-25T09:35:51.417534+0000","last_fullsized":"2024-04-25T09:35:51.417534+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2572288,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":2512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.581846+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:34.581846+0000","last_peered":"2024-04-25T09:35:34.581846+0000","last_clean":"2024-04-25T09:35:34.581846+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:34.581846+0000","last_undegraded":"2024-04-25T09:35:34.581846+0000","last_fullsized":"2024-04-25T09:35:34.581846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"59'293","reported_seq":314,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.439520+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:52.439520+0000","last_peered":"2024-04-25T09:35:52.439520+0000","last_clean":"2024-04-25T09:35:52.439520+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:52.439520+0000","last_undegraded":"2024-04-25T09:35:52.439520+0000","last_fullsized":"2024-04-25T09:35:52.439520+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2408448,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":2352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.475550+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:34.475550+0000","last_peered":"2024-04-25T09:35:34.475550+0000","last_clean":"2024-04-25T09:35:34.475550+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:34.475550+0000","last_undegraded":"2024-04-25T09:35:34.475550+0000","last_fullsized":"2024-04-25T09:35:34.475550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"59'335","reported_seq":354,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.322468+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:50.322468+0000","last_peered":"2024-04-25T09:35:50.322468+0000","last_clean":"2024-04-25T09:35:50.322468+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:50.322468+0000","last_undegraded":"2024-04-25T09:35:50.322468+0000","last_fullsized":"2024-04-25T09:35:50.322468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":124,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.610640+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:34.610640+0000","last_peered":"2024-04-25T09:35:34.610640+0000","last_clean":"2024-04-25T09:35:34.610640+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:34.610640+0000","last_undegraded":"2024-04-25T09:35:34.610640+0000","last_fullsized":"2024-04-25T09:35:34.610640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"59'271","reported_seq":294,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.992355+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:50.992355+0000","last_peered":"2024-04-25T09:35:50.992355+0000","last_clean":"2024-04-25T09:35:50.992355+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:50.992355+0000","last_undegraded":"2024-04-25T09:35:50.992355+0000","last_fullsized":"2024-04-25T09:35:50.992355+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.509202+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:34.509202+0000","last_peered":"2024-04-25T09:35:34.509202+0000","last_clean":"2024-04-25T09:35:34.509202+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:34.509202+0000","last_undegraded":"2024-04-25T09:35:34.509202+0000","last_fullsized":"2024-04-25T09:35:34.509202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"59'295","reported_seq":316,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:50.514065+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:50.514065+0000","last_peered":"2024-04-25T09:35:50.514065+0000","last_clean":"2024-04-25T09:35:50.514065+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:50.514065+0000","last_undegraded":"2024-04-25T09:35:50.514065+0000","last_fullsized":"2024-04-25T09:35:50.514065+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.534732+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:34.534732+0000","last_peered":"2024-04-25T09:35:34.534732+0000","last_clean":"2024-04-25T09:35:34.534732+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:34.534732+0000","last_undegraded":"2024-04-25T09:35:34.534732+0000","last_fullsized":"2024-04-25T09:35:34.534732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"59'311","reported_seq":332,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:52.423318+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:52.423318+0000","last_peered":"2024-04-25T09:35:52.423318+0000","last_clean":"2024-04-25T09:35:52.423318+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:52.423318+0000","last_undegraded":"2024-04-25T09:35:52.423318+0000","last_fullsized":"2024-04-25T09:35:52.423318+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.517776+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:34.517776+0000","last_peered":"2024-04-25T09:35:34.517776+0000","last_clean":"2024-04-25T09:35:34.517776+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:34.517776+0000","last_undegraded":"2024-04-25T09:35:34.517776+0000","last_fullsized":"2024-04-25T09:35:34.517776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"59'367","reported_seq":388,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:51.347725+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:51.347725+0000","last_peered":"2024-04-25T09:35:51.347725+0000","last_clean":"2024-04-25T09:35:51.347725+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:51.347725+0000","last_undegraded":"2024-04-25T09:35:51.347725+0000","last_fullsized":"2024-04-25T09:35:51.347725+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-25T09:35:34.495772+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:34.495772+0000","last_peered":"2024-04-25T09:35:34.495772+0000","last_clean":"2024-04-25T09:35:34.495772+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:34.495772+0000","last_undegraded":"2024-04-25T09:35:34.495772+0000","last_fullsized":"2024-04-25T09:35:34.495772+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":44957696,"num_objects":687,"num_object_clones":0,"num_object_copies":2061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5488,"num_write_kb":43904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":67424256,"data_stored":134848512,"data_compressed":6959673,"data_compressed_allocated":67424256,"data_compressed_original":134848512,"omap_allocated":0,"internal_metadata":0},"log_size":5472,"ondisk_log_size":5472,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106152,"kb_used_data":21020,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94265688,"statfs":{"total":96636764160,"available":96528064512,"internally_reserved":0,"allocated":21524480,"data_stored":42689395,"data_compressed":2193420,"data_compressed_allocated":21000192,"data_compressed_original":42491904,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673449,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97476,"kb_used_data":12348,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94274364,"statfs":{"total":96636764160,"available":96536948736,"internally_reserved":0,"allocated":12644352,"data_stored":24929139,"data_compressed":1276860,"data_compressed_allocated":12120064,"data_compressed_original":24731648,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111932,"kb_used_data":18484,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94259908,"statfs":{"total":96636764160,"available":96522145792,"internally_reserved":0,"allocated":18927616,"data_stored":37028179,"data_compressed":1901696,"data_compressed_allocated":18423808,"data_compressed_original":36847616,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706153,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108792,"kb_used_data":15340,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94263048,"statfs":{"total":96636764160,"available":96525361152,"internally_reserved":0,"allocated":15708160,"data_stored":31056755,"data_compressed":1592998,"data_compressed_allocated":15183872,"data_compressed_original":30859264,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15310848,"data_stored":30621696,"data_compressed":1580374,"data_compressed_allocated":15310848,"data_compressed_original":30621696,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18657280,"data_stored":37314560,"data_compressed":1925807,"data_compressed_allocated":18657280,"data_compressed_original":37314560,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12279808,"data_stored":24559616,"data_compressed":1267620,"data_compressed_allocated":12279808,"data_compressed_original":24559616,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21176320,"data_stored":42352640,"data_compressed":2185872,"data_compressed_allocated":21176320,"data_compressed_original":42352640,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:35:57.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 6170 6154 1.04508 0.953125 0.0715231 0.119323 2024-04-25T09:35:57.490 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:35:57.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:57.626+0000 7f26662ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:57.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:35:57.633+0000 7f26662ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:58.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 6301 6285 1.04462 1.02344 0.0942846 0.119482 2024-04-25T09:35:59.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 6430 6414 1.04385 1.00781 0.0648133 0.119583 2024-04-25T09:35:59.870 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:35:59.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:00.006+0000 7f1b14b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:35:59.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:00.012+0000 7f1b14b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:00.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 6562 6546 1.04359 1.03125 0.090546 0.119617 2024-04-25T09:36:01.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 6697 6681 1.04381 1.05469 0.235271 0.119611 2024-04-25T09:36:01.638 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:01.638 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:01.639 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:01.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:01.771+0000 7f7b0659d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:01.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:01.780+0000 7f7b0659d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:01.976 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:01.977 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:01.992 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-04-25T09:36:01.331313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50479648,"num_objects":765,"num_object_clones":0,"num_object_copies":2295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6227,"num_write_kb":50614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6175,"ondisk_log_size":6175,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":407004,"kb_used_data":74812,"kb_used_omap":0,"kb_used_meta":332160,"kb_avail":377080356,"statfs":{"total":386547056640,"available":386130284544,"internally_reserved":0,"allocated":76607488,"data_stored":151138421,"data_compressed":7759791,"data_compressed_allocated":74424320,"data_compressed_original":150323200,"omap_allocated":0,"internal_metadata":340131840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4931584,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":602,"num_write_kb":4816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.817870"},"pg_stats":[{"pgid":"7.f","version":"62'415","reported_seq":445,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.727386+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:35:54.727386+0000","last_peered":"2024-04-25T09:35:54.727386+0000","last_clean":"2024-04-25T09:35:54.727386+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:35:54.727386+0000","last_undegraded":"2024-04-25T09:35:54.727386+0000","last_fullsized":"2024-04-25T09:35:54.727386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"59'384","reported_seq":409,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.618893+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:35:54.618893+0000","last_peered":"2024-04-25T09:35:54.618893+0000","last_clean":"2024-04-25T09:35:54.618893+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:35:54.618893+0000","last_undegraded":"2024-04-25T09:35:54.618893+0000","last_fullsized":"2024-04-25T09:35:54.618893+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"60'336","reported_seq":363,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.625074+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:35:54.625074+0000","last_peered":"2024-04-25T09:35:54.625074+0000","last_clean":"2024-04-25T09:35:54.625074+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:35:54.625074+0000","last_undegraded":"2024-04-25T09:35:54.625074+0000","last_fullsized":"2024-04-25T09:35:54.625074+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"62'423","reported_seq":451,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:56.159470+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:35:56.159470+0000","last_peered":"2024-04-25T09:35:56.159470+0000","last_clean":"2024-04-25T09:35:56.159470+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:35:56.159470+0000","last_undegraded":"2024-04-25T09:35:56.159470+0000","last_fullsized":"2024-04-25T09:35:56.159470+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"62'455","reported_seq":485,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.994134+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:35:55.994134+0000","last_peered":"2024-04-25T09:35:55.994134+0000","last_clean":"2024-04-25T09:35:55.994134+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:35:55.994134+0000","last_undegraded":"2024-04-25T09:35:55.994134+0000","last_fullsized":"2024-04-25T09:35:55.994134+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"62'335","reported_seq":365,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:57.141490+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:35:57.141490+0000","last_peered":"2024-04-25T09:35:57.141490+0000","last_clean":"2024-04-25T09:35:57.141490+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:35:57.141490+0000","last_undegraded":"2024-04-25T09:35:57.141490+0000","last_fullsized":"2024-04-25T09:35:57.141490+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"62'445","reported_seq":473,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:57.431514+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:35:57.431514+0000","last_peered":"2024-04-25T09:35:57.431514+0000","last_clean":"2024-04-25T09:35:57.431514+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:35:57.431514+0000","last_undegraded":"2024-04-25T09:35:57.431514+0000","last_fullsized":"2024-04-25T09:35:57.431514+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653632,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":446,"num_write_kb":3568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"62'343","reported_seq":369,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.219921+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:35:55.219921+0000","last_peered":"2024-04-25T09:35:55.219921+0000","last_clean":"2024-04-25T09:35:55.219921+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:35:55.219921+0000","last_undegraded":"2024-04-25T09:35:55.219921+0000","last_fullsized":"2024-04-25T09:35:55.219921+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"62'495","reported_seq":525,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:57.253308+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:35:57.253308+0000","last_peered":"2024-04-25T09:35:57.253308+0000","last_clean":"2024-04-25T09:35:57.253308+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:35:57.253308+0000","last_undegraded":"2024-04-25T09:35:57.253308+0000","last_fullsized":"2024-04-25T09:35:57.253308+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":270,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.672664+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:54.672664+0000","last_peered":"2024-04-25T09:35:54.672664+0000","last_clean":"2024-04-25T09:35:54.672664+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:54.672664+0000","last_undegraded":"2024-04-25T09:35:54.672664+0000","last_fullsized":"2024-04-25T09:35:54.672664+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":129,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.651952+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:54.651952+0000","last_peered":"2024-04-25T09:35:54.651952+0000","last_clean":"2024-04-25T09:35:54.651952+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:54.651952+0000","last_undegraded":"2024-04-25T09:35:54.651952+0000","last_fullsized":"2024-04-25T09:35:54.651952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"62'369","reported_seq":395,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:56.422545+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:35:56.422545+0000","last_peered":"2024-04-25T09:35:56.422545+0000","last_clean":"2024-04-25T09:35:56.422545+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:35:56.422545+0000","last_undegraded":"2024-04-25T09:35:56.422545+0000","last_fullsized":"2024-04-25T09:35:56.422545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031040,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"62'343","reported_seq":371,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:56.395264+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:35:56.395264+0000","last_peered":"2024-04-25T09:35:56.395264+0000","last_clean":"2024-04-25T09:35:56.395264+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:35:56.395264+0000","last_undegraded":"2024-04-25T09:35:56.395264+0000","last_fullsized":"2024-04-25T09:35:56.395264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.631144+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:54.631144+0000","last_peered":"2024-04-25T09:35:54.631144+0000","last_clean":"2024-04-25T09:35:54.631144+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:54.631144+0000","last_undegraded":"2024-04-25T09:35:54.631144+0000","last_fullsized":"2024-04-25T09:35:54.631144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"59'344","reported_seq":369,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.649735+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:35:54.649735+0000","last_peered":"2024-04-25T09:35:54.649735+0000","last_clean":"2024-04-25T09:35:54.649735+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:35:54.649735+0000","last_undegraded":"2024-04-25T09:35:54.649735+0000","last_fullsized":"2024-04-25T09:35:54.649735+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"62'304","reported_seq":336,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.556404+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:35:55.556404+0000","last_peered":"2024-04-25T09:35:55.556404+0000","last_clean":"2024-04-25T09:35:55.556404+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:35:55.556404+0000","last_undegraded":"2024-04-25T09:35:55.556404+0000","last_fullsized":"2024-04-25T09:35:55.556404+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":135,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.625547+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:54.625547+0000","last_peered":"2024-04-25T09:35:54.625547+0000","last_clean":"2024-04-25T09:35:54.625547+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:54.625547+0000","last_undegraded":"2024-04-25T09:35:54.625547+0000","last_fullsized":"2024-04-25T09:35:54.625547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"62'327","reported_seq":355,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:56.803741+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:35:56.803741+0000","last_peered":"2024-04-25T09:35:56.803741+0000","last_clean":"2024-04-25T09:35:56.803741+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:35:56.803741+0000","last_undegraded":"2024-04-25T09:35:56.803741+0000","last_fullsized":"2024-04-25T09:35:56.803741+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.667498+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:54.667498+0000","last_peered":"2024-04-25T09:35:54.667498+0000","last_clean":"2024-04-25T09:35:54.667498+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:54.667498+0000","last_undegraded":"2024-04-25T09:35:54.667498+0000","last_fullsized":"2024-04-25T09:35:54.667498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"62'369","reported_seq":399,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:57.430099+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:35:57.430099+0000","last_peered":"2024-04-25T09:35:57.430099+0000","last_clean":"2024-04-25T09:35:57.430099+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:35:57.430099+0000","last_undegraded":"2024-04-25T09:35:57.430099+0000","last_fullsized":"2024-04-25T09:35:57.430099+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031040,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":370,"num_write_kb":2960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":135,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.640141+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:54.640141+0000","last_peered":"2024-04-25T09:35:54.640141+0000","last_clean":"2024-04-25T09:35:54.640141+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:54.640141+0000","last_undegraded":"2024-04-25T09:35:54.640141+0000","last_fullsized":"2024-04-25T09:35:54.640141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"62'391","reported_seq":421,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:56.786296+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:35:56.786296+0000","last_peered":"2024-04-25T09:35:56.786296+0000","last_clean":"2024-04-25T09:35:56.786296+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:35:56.786296+0000","last_undegraded":"2024-04-25T09:35:56.786296+0000","last_fullsized":"2024-04-25T09:35:56.786296+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":129,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-25T09:35:54.633523+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:54.633523+0000","last_peered":"2024-04-25T09:35:54.633523+0000","last_clean":"2024-04-25T09:35:54.633523+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:54.633523+0000","last_undegraded":"2024-04-25T09:35:54.633523+0000","last_fullsized":"2024-04-25T09:35:54.633523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":49889280,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6090,"num_write_kb":48720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74833920,"data_stored":149667840,"data_compressed":7724880,"data_compressed_allocated":74833920,"data_compressed_original":149667840,"omap_allocated":0,"internal_metadata":0},"log_size":6078,"ondisk_log_size":6078,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108596,"kb_used_data":23468,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94263244,"statfs":{"total":96636764160,"available":96525561856,"internally_reserved":0,"allocated":24031232,"data_stored":47663482,"data_compressed":2449758,"data_compressed_allocated":23482368,"data_compressed_original":47456256,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99080,"kb_used_data":13952,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94272760,"statfs":{"total":96636764160,"available":96535306240,"internally_reserved":0,"allocated":14286848,"data_stored":28174714,"data_compressed":1443945,"data_compressed_allocated":13737984,"data_compressed_original":27967488,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101312,"kb_used_data":20344,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94270528,"statfs":{"total":96636764160,"available":96533020672,"internally_reserved":0,"allocated":20832256,"data_stored":40798042,"data_compressed":2095853,"data_compressed_allocated":20303872,"data_compressed_original":40607744,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98016,"kb_used_data":17048,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94273824,"statfs":{"total":96636764160,"available":96536395776,"internally_reserved":0,"allocated":17457152,"data_stored":34502183,"data_compressed":1770235,"data_compressed_allocated":16900096,"data_compressed_original":34291712,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16977920,"data_stored":33955840,"data_compressed":1752535,"data_compressed_allocated":16977920,"data_compressed_original":33955840,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20455424,"data_stored":40910848,"data_compressed":2111504,"data_compressed_allocated":20455424,"data_compressed_original":40910848,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13795328,"data_stored":27590656,"data_compressed":1424130,"data_compressed_allocated":13795328,"data_compressed_original":27590656,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23605248,"data_stored":47210496,"data_compressed":2436711,"data_compressed_allocated":23605248,"data_compressed_original":47210496,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:02.232 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:02.382 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:02.394+0000 7fe85475d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:02.386 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:02.401+0000 7fe85475d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:02.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 6818 6802 1.04188 0.945312 0.123601 0.119787 2024-04-25T09:36:03.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 6953 6937 1.04212 1.05469 0.136796 0.119783 2024-04-25T09:36:04.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 7080 7064 1.04118 0.992188 0.103914 0.119869 2024-04-25T09:36:04.533 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:04.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:04.671+0000 7fc45426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:04.663 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:04.678+0000 7fc45426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:05.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 7205 7189 1.03998 0.976562 0.162364 0.120014 2024-04-25T09:36:06.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 7341 7325 1.04039 1.0625 0.111202 0.120022 2024-04-25T09:36:06.886 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:06.995 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:06.995 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:06.995 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:07.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:07.030+0000 7f7789f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:07.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:07.037+0000 7f7789f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:07.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:07.136+0000 7fb6836ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:07.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:07.148+0000 7fb6836ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:07.400 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:07.400 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:07.415 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-04-25T09:36:07.332530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":57401888,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7072,"num_write_kb":57374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7016,"ondisk_log_size":7016,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":431120,"kb_used_data":86448,"kb_used_omap":0,"kb_used_meta":344640,"kb_avail":377056240,"statfs":{"total":386547056640,"available":386105589760,"internally_reserved":0,"allocated":88522752,"data_stored":174929532,"data_compressed":8987760,"data_compressed_allocated":86315008,"data_compressed_original":174104576,"omap_allocated":0,"internal_metadata":352911360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11853824,"num_objects":182,"num_object_clones":0,"num_object_copies":546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1447,"num_write_kb":11576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.811354"},"pg_stats":[{"pgid":"7.f","version":"63'455","reported_seq":488,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:00.433717+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:00.433717+0000","last_peered":"2024-04-25T09:36:00.433717+0000","last_clean":"2024-04-25T09:36:00.433717+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:00.433717+0000","last_undegraded":"2024-04-25T09:36:00.433717+0000","last_fullsized":"2024-04-25T09:36:00.433717+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'431","reported_seq":460,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:05.623216+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:05.623216+0000","last_peered":"2024-04-25T09:36:05.623216+0000","last_clean":"2024-04-25T09:36:05.623216+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:05.623216+0000","last_undegraded":"2024-04-25T09:36:05.623216+0000","last_fullsized":"2024-04-25T09:36:05.623216+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'399","reported_seq":430,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:00.725998+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:00.725998+0000","last_peered":"2024-04-25T09:36:00.725998+0000","last_clean":"2024-04-25T09:36:00.725998+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:00.725998+0000","last_undegraded":"2024-04-25T09:36:00.725998+0000","last_fullsized":"2024-04-25T09:36:00.725998+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'455","reported_seq":486,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:00.878377+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:00.878377+0000","last_peered":"2024-04-25T09:36:00.878377+0000","last_clean":"2024-04-25T09:36:00.878377+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:00.878377+0000","last_undegraded":"2024-04-25T09:36:00.878377+0000","last_fullsized":"2024-04-25T09:36:00.878377+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'471","reported_seq":504,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:01.450236+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:01.450236+0000","last_peered":"2024-04-25T09:36:01.450236+0000","last_clean":"2024-04-25T09:36:01.450236+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:01.450236+0000","last_undegraded":"2024-04-25T09:36:01.450236+0000","last_fullsized":"2024-04-25T09:36:01.450236+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'391","reported_seq":424,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:01.162432+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:01.162432+0000","last_peered":"2024-04-25T09:36:01.162432+0000","last_clean":"2024-04-25T09:36:01.162432+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:01.162432+0000","last_undegraded":"2024-04-25T09:36:01.162432+0000","last_fullsized":"2024-04-25T09:36:01.162432+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'481","reported_seq":512,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:02.404230+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:02.404230+0000","last_peered":"2024-04-25T09:36:02.404230+0000","last_clean":"2024-04-25T09:36:02.404230+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:02.404230+0000","last_undegraded":"2024-04-25T09:36:02.404230+0000","last_fullsized":"2024-04-25T09:36:02.404230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3948544,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":482,"num_write_kb":3856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'439","reported_seq":468,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.056330+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:06.056330+0000","last_peered":"2024-04-25T09:36:06.056330+0000","last_clean":"2024-04-25T09:36:06.056330+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:06.056330+0000","last_undegraded":"2024-04-25T09:36:06.056330+0000","last_fullsized":"2024-04-25T09:36:06.056330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'519","reported_seq":552,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:02.463885+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:02.463885+0000","last_peered":"2024-04-25T09:36:02.463885+0000","last_clean":"2024-04-25T09:36:02.463885+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:02.463885+0000","last_undegraded":"2024-04-25T09:36:02.463885+0000","last_fullsized":"2024-04-25T09:36:02.463885+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'466","reported_seq":495,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.443569+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:06.443569+0000","last_peered":"2024-04-25T09:36:06.443569+0000","last_clean":"2024-04-25T09:36:06.443569+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:06.443569+0000","last_undegraded":"2024-04-25T09:36:06.443569+0000","last_fullsized":"2024-04-25T09:36:06.443569+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825664,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":3736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'383","reported_seq":414,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:02.374179+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:02.374179+0000","last_peered":"2024-04-25T09:36:02.374179+0000","last_clean":"2024-04-25T09:36:02.374179+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:02.374179+0000","last_undegraded":"2024-04-25T09:36:02.374179+0000","last_fullsized":"2024-04-25T09:36:02.374179+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'455","reported_seq":484,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:04.894438+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:04.894438+0000","last_peered":"2024-04-25T09:36:04.894438+0000","last_clean":"2024-04-25T09:36:04.894438+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:04.894438+0000","last_undegraded":"2024-04-25T09:36:04.894438+0000","last_fullsized":"2024-04-25T09:36:04.894438+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'351","reported_seq":384,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.463733+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:06.463733+0000","last_peered":"2024-04-25T09:36:06.463733+0000","last_clean":"2024-04-25T09:36:06.463733+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:06.463733+0000","last_undegraded":"2024-04-25T09:36:06.463733+0000","last_fullsized":"2024-04-25T09:36:06.463733+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'375","reported_seq":406,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:02.122691+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:02.122691+0000","last_peered":"2024-04-25T09:36:02.122691+0000","last_clean":"2024-04-25T09:36:02.122691+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:02.122691+0000","last_undegraded":"2024-04-25T09:36:02.122691+0000","last_fullsized":"2024-04-25T09:36:02.122691+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'409","reported_seq":442,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:02.413607+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:02.413607+0000","last_peered":"2024-04-25T09:36:02.413607+0000","last_clean":"2024-04-25T09:36:02.413607+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:02.413607+0000","last_undegraded":"2024-04-25T09:36:02.413607+0000","last_fullsized":"2024-04-25T09:36:02.413607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3358720,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":410,"num_write_kb":3280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'439","reported_seq":472,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:01.662890+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:01.662890+0000","last_peered":"2024-04-25T09:36:01.662890+0000","last_clean":"2024-04-25T09:36:01.662890+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:01.662890+0000","last_undegraded":"2024-04-25T09:36:01.662890+0000","last_fullsized":"2024-04-25T09:36:01.662890+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":56811520,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6935,"num_write_kb":55480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":86839296,"data_stored":173678592,"data_compressed":8964693,"data_compressed_allocated":86839296,"data_compressed_original":173678592,"omap_allocated":0,"internal_metadata":0},"log_size":6919,"ondisk_log_size":6919,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115228,"kb_used_data":25940,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94256612,"statfs":{"total":96636764160,"available":96518770688,"internally_reserved":0,"allocated":26562560,"data_stored":52712999,"data_compressed":2710326,"data_compressed_allocated":26005504,"data_compressed_original":52502528,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100652,"kb_used_data":15524,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94271188,"statfs":{"total":96636764160,"available":96533696512,"internally_reserved":0,"allocated":15896576,"data_stored":31381031,"data_compressed":1609338,"data_compressed_allocated":15339520,"data_compressed_original":31170560,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109632,"kb_used_data":24504,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94262208,"statfs":{"total":96636764160,"available":96524500992,"internally_reserved":0,"allocated":25092096,"data_stored":49304583,"data_compressed":2534927,"data_compressed_allocated":24555520,"data_compressed_original":49111040,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105608,"kb_used_data":20480,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94266232,"statfs":{"total":96636764160,"available":96528621568,"internally_reserved":0,"allocated":20971520,"data_stored":41530919,"data_compressed":2133169,"data_compressed_allocated":20414464,"data_compressed_original":41320448,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20492288,"data_stored":40984576,"data_compressed":2115469,"data_compressed_allocated":20492288,"data_compressed_original":40984576,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24793088,"data_stored":49586176,"data_compressed":2559461,"data_compressed_allocated":24793088,"data_compressed_original":49586176,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15384576,"data_stored":30769152,"data_compressed":1588254,"data_compressed_allocated":15384576,"data_compressed_original":30769152,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26169344,"data_stored":52338688,"data_compressed":2701509,"data_compressed_allocated":26169344,"data_compressed_original":52338688,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:07.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 7467 7451 1.03939 0.984375 0.0630152 0.12005 2024-04-25T09:36:08.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 7604 7588 1.03993 1.07031 0.0539306 0.120071 2024-04-25T09:36:09.218 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:09.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:09.354+0000 7fcabacad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:09.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:09.363+0000 7fcabacad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:09.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 7727 7711 1.03856 0.960938 0.123132 0.120213 2024-04-25T09:36:10.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 7859 7843 1.03844 1.03125 0.0704429 0.12021 2024-04-25T09:36:11.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:36:11.489278+0000 min lat: 0.0148642 max lat: 0.372481 avg lat: 0.120193 2024-04-25T09:36:11.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:36:11.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 7992 7976 1.03845 1.03906 0.111408 0.120193 2024-04-25T09:36:11.607 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:11.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:11.741+0000 7f1a8ee6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:11.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:11.747+0000 7f1a8ee6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:12.418 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:12.418 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:12.418 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:12.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 8120 8104 1.03782 1 0.213907 0.120257 2024-04-25T09:36:12.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:12.551+0000 7f489206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:12.546 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:12.560+0000 7f489206d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:12.750 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:12.750 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:12.766 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-04-25T09:36:11.333316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61334048,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7552,"num_write_kb":61214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7496,"ondisk_log_size":7496,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":443256,"kb_used_data":90260,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":377044104,"statfs":{"total":386547056640,"available":386093162496,"internally_reserved":0,"allocated":92426240,"data_stored":182736508,"data_compressed":9390879,"data_compressed_allocated":90218496,"data_compressed_original":181911552,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10854400,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1325,"num_write_kb":10600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002435"},"pg_stats":[{"pgid":"7.f","version":"63'495","reported_seq":528,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.986026+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:06.986026+0000","last_peered":"2024-04-25T09:36:06.986026+0000","last_clean":"2024-04-25T09:36:06.986026+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:06.986026+0000","last_undegraded":"2024-04-25T09:36:06.986026+0000","last_fullsized":"2024-04-25T09:36:06.986026+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'431","reported_seq":460,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:05.623216+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:05.623216+0000","last_peered":"2024-04-25T09:36:05.623216+0000","last_clean":"2024-04-25T09:36:05.623216+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:05.623216+0000","last_undegraded":"2024-04-25T09:36:05.623216+0000","last_fullsized":"2024-04-25T09:36:05.623216+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'439","reported_seq":470,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:07.086740+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:07.086740+0000","last_peered":"2024-04-25T09:36:07.086740+0000","last_clean":"2024-04-25T09:36:07.086740+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:07.086740+0000","last_undegraded":"2024-04-25T09:36:07.086740+0000","last_fullsized":"2024-04-25T09:36:07.086740+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'495","reported_seq":526,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.910899+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:06.910899+0000","last_peered":"2024-04-25T09:36:06.910899+0000","last_clean":"2024-04-25T09:36:06.910899+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:06.910899+0000","last_undegraded":"2024-04-25T09:36:06.910899+0000","last_fullsized":"2024-04-25T09:36:06.910899+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'531","reported_seq":564,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:07.432098+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:07.432098+0000","last_peered":"2024-04-25T09:36:07.432098+0000","last_clean":"2024-04-25T09:36:07.432098+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:07.432098+0000","last_undegraded":"2024-04-25T09:36:07.432098+0000","last_fullsized":"2024-04-25T09:36:07.432098+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4358144,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532,"num_write_kb":4256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'423","reported_seq":456,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:05.839393+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:05.839393+0000","last_peered":"2024-04-25T09:36:05.839393+0000","last_clean":"2024-04-25T09:36:05.839393+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:05.839393+0000","last_undegraded":"2024-04-25T09:36:05.839393+0000","last_fullsized":"2024-04-25T09:36:05.839393+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'527","reported_seq":558,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.230153+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:06.230153+0000","last_peered":"2024-04-25T09:36:06.230153+0000","last_clean":"2024-04-25T09:36:06.230153+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:06.230153+0000","last_undegraded":"2024-04-25T09:36:06.230153+0000","last_fullsized":"2024-04-25T09:36:06.230153+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'439","reported_seq":468,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.056330+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:06.056330+0000","last_peered":"2024-04-25T09:36:06.056330+0000","last_clean":"2024-04-25T09:36:06.056330+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:06.056330+0000","last_undegraded":"2024-04-25T09:36:06.056330+0000","last_fullsized":"2024-04-25T09:36:06.056330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'591","reported_seq":624,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:07.248695+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:07.248695+0000","last_peered":"2024-04-25T09:36:07.248695+0000","last_clean":"2024-04-25T09:36:07.248695+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:07.248695+0000","last_undegraded":"2024-04-25T09:36:07.248695+0000","last_fullsized":"2024-04-25T09:36:07.248695+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'466","reported_seq":495,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.443569+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:06.443569+0000","last_peered":"2024-04-25T09:36:06.443569+0000","last_clean":"2024-04-25T09:36:06.443569+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:06.443569+0000","last_undegraded":"2024-04-25T09:36:06.443569+0000","last_fullsized":"2024-04-25T09:36:06.443569+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3825664,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":3736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'423","reported_seq":454,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:07.232022+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:07.232022+0000","last_peered":"2024-04-25T09:36:07.232022+0000","last_clean":"2024-04-25T09:36:07.232022+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:07.232022+0000","last_undegraded":"2024-04-25T09:36:07.232022+0000","last_fullsized":"2024-04-25T09:36:07.232022+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'455","reported_seq":484,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:04.894438+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:04.894438+0000","last_peered":"2024-04-25T09:36:04.894438+0000","last_clean":"2024-04-25T09:36:04.894438+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:04.894438+0000","last_undegraded":"2024-04-25T09:36:04.894438+0000","last_fullsized":"2024-04-25T09:36:04.894438+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'351","reported_seq":384,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.463733+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:06.463733+0000","last_peered":"2024-04-25T09:36:06.463733+0000","last_clean":"2024-04-25T09:36:06.463733+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:06.463733+0000","last_undegraded":"2024-04-25T09:36:06.463733+0000","last_fullsized":"2024-04-25T09:36:06.463733+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'415","reported_seq":446,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:07.133612+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:07.133612+0000","last_peered":"2024-04-25T09:36:07.133612+0000","last_clean":"2024-04-25T09:36:07.133612+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:07.133612+0000","last_undegraded":"2024-04-25T09:36:07.133612+0000","last_fullsized":"2024-04-25T09:36:07.133612+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'447","reported_seq":480,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:07.385447+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:07.385447+0000","last_peered":"2024-04-25T09:36:07.385447+0000","last_clean":"2024-04-25T09:36:07.385447+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:07.385447+0000","last_undegraded":"2024-04-25T09:36:07.385447+0000","last_fullsized":"2024-04-25T09:36:07.385447+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'471","reported_seq":504,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:06.230677+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:06.230677+0000","last_peered":"2024-04-25T09:36:06.230677+0000","last_clean":"2024-04-25T09:36:06.230677+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:06.230677+0000","last_undegraded":"2024-04-25T09:36:06.230677+0000","last_fullsized":"2024-04-25T09:36:06.230677+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":60743680,"num_objects":928,"num_object_clones":0,"num_object_copies":2784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7415,"num_write_kb":59320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90755072,"data_stored":181510144,"data_compressed":9369081,"data_compressed_allocated":90755072,"data_compressed_original":181510144,"omap_allocated":0,"internal_metadata":0},"log_size":7399,"ondisk_log_size":7399,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121932,"kb_used_data":28484,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94249908,"statfs":{"total":96636764160,"available":96511905792,"internally_reserved":0,"allocated":29167616,"data_stored":57923111,"data_compressed":2979354,"data_compressed_allocated":28610560,"data_compressed_original":57712640,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106084,"kb_used_data":16792,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94265756,"statfs":{"total":96636764160,"available":96528134144,"internally_reserved":0,"allocated":17195008,"data_stored":33977895,"data_compressed":1743429,"data_compressed_allocated":16637952,"data_compressed_original":33767424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":109632,"kb_used_data":24504,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94262208,"statfs":{"total":96636764160,"available":96524500992,"internally_reserved":0,"allocated":25092096,"data_stored":49304583,"data_compressed":2534927,"data_compressed_allocated":24555520,"data_compressed_original":49111040,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105608,"kb_used_data":20480,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94266232,"statfs":{"total":96636764160,"available":96528621568,"internally_reserved":0,"allocated":20971520,"data_stored":41530919,"data_compressed":2133169,"data_compressed_allocated":20414464,"data_compressed_original":41320448,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20492288,"data_stored":40984576,"data_compressed":2115469,"data_compressed_allocated":20492288,"data_compressed_original":40984576,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24793088,"data_stored":49586176,"data_compressed":2559461,"data_compressed_allocated":24793088,"data_compressed_original":49586176,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16744448,"data_stored":33488896,"data_compressed":1728690,"data_compressed_allocated":16744448,"data_compressed_original":33488896,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28725248,"data_stored":57450496,"data_compressed":2965461,"data_compressed_allocated":28725248,"data_compressed_original":57450496,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:13.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 8238 8222 1.03594 0.921875 0.146135 0.12046 2024-04-25T09:36:13.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:14.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:14.055+0000 7fd8a126d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:14.047 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:14.061+0000 7fd8a126d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:14.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 8353 8337 1.03376 0.898438 0.0820821 0.12076 2024-04-25T09:36:15.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 8480 8464 1.03311 0.992188 0.132016 0.12086 2024-04-25T09:36:16.189 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:16.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:16.343+0000 7fb23f82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:16.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:16.349+0000 7fb23f82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:16.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 8596 8580 1.03116 0.90625 0.0897563 0.121041 2024-04-25T09:36:17.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 8722 8706 1.03045 0.984375 0.113966 0.121198 2024-04-25T09:36:17.768 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:17.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:17.768 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:36:17.769 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:36:17.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:17.897+0000 7f464e22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:17.893 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:17.907+0000 7f464e22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:17.994 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:17.995 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:17.995 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:17.995 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:17.995 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:17.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:17.998 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:17.998 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:36:18.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.132+0000 7faf224ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:18.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.145+0000 7faf224ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:18.237 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:18.238 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:18.238 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:18.238 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:18.240 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:18.241 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:18.241 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:36:18.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.368+0000 7f7f6382d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:18.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.379+0000 7f7f6382d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:18.380 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:18.381 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:18.384 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:18.384 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:18.384 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:36:18.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 8854 8838 1.03046 1.03125 0.182363 0.121172 2024-04-25T09:36:18.496 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:18.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.513+0000 7f852862d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:18.510 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.523+0000 7f852862d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:18.569 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:18.570 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:18.573 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:18.574 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:18.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.637+0000 7fc59dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:18.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:18.645+0000 7fc59dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:19.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 8980 8964 1.02978 0.984375 0.0282091 0.121267 2024-04-25T09:36:20.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 9091 9075 1.02742 0.867188 0.065781 0.121521 2024-04-25T09:36:20.919 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:21.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:21.047+0000 7f32898ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:21.040 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:21.054+0000 7f32898ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:21.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 9210 9194 1.02602 0.929688 0.154779 0.121665 2024-04-25T09:36:22.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 9342 9326 1.0261 1.03125 0.0424372 0.121651 2024-04-25T09:36:23.224 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:23.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:23.362+0000 7fed16c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:23.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:23.369+0000 7fed16c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:23.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 9465 9449 1.02519 0.960938 0.211066 0.12177 2024-04-25T09:36:23.575 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:23.575 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:23.575 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:36:23.575 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:36:23.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:23.705+0000 7f2dda79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:23.702 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:23.716+0000 7f2dda79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:23.736 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:23.737 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:23.737 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:23.737 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:23.739 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:23.740 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:23.740 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:36:23.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:23.867+0000 7f96a42ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:23.862 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:23.876+0000 7f96a42ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:23.890 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:23.890 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:23.890 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:23.890 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:23.890 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:23.893 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:23.893 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:23.893 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:36:24.015 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:24.022+0000 7fa579e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:24.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:24.034+0000 7fa579e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:24.042 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:24.045 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:24.045 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:24.045 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:36:24.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:24.183+0000 7f6ad8c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:24.180 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:24.194+0000 7f6ad8c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:24.204 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:24.204 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:24.204 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:24.204 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:24.204 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:24.204 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:24.204 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:24.205 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:24.205 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:24.205 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:24.205 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:24.205 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:24.207 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:24.208 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:24.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 9585 9569 1.02399 0.9375 0.119011 0.121945 2024-04-25T09:36:25.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 9699 9683 1.02218 0.890625 0.255881 0.122131 2024-04-25T09:36:25.591 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:25.716 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:25.728+0000 7fb78bd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:25.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:25.734+0000 7fb78bd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:26.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 9825 9809 1.02168 0.984375 0.100584 0.122238 2024-04-25T09:36:27.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 9942 9926 1.02026 0.914062 0.0340214 0.122377 2024-04-25T09:36:27.929 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:28.062 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:28.074+0000 7fab60d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:28.067 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:28.081+0000 7fab60d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:28.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 10076 10060 1.02061 1.04688 0.103482 0.122388 2024-04-25T09:36:29.209 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:29.209 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:29.210 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:29.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:29.352+0000 7f5407c24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:29.347 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:29.361+0000 7f5407c24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:29.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 10187 10171 1.01864 0.867188 0.161843 0.122588 2024-04-25T09:36:29.577 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:29.577 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:29.590 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-04-25T09:36:29.337489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":81658400,"num_objects":1240,"num_object_clones":0,"num_object_copies":3720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10033,"num_write_kb":81062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9977,"ondisk_log_size":9977,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":481480,"kb_used_data":120164,"kb_used_omap":0,"kb_used_meta":361280,"kb_avail":377005880,"statfs":{"total":386547056640,"available":386054021120,"internally_reserved":0,"allocated":123047936,"data_stored":243979900,"data_compressed":12553227,"data_compressed_allocated":120840192,"data_compressed_original":243154944,"omap_allocated":0,"internal_metadata":369950720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13467648,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1644,"num_write_kb":13152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002773"},"pg_stats":[{"pgid":"7.f","version":"63'623","reported_seq":656,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.812836+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:26.812836+0000","last_peered":"2024-04-25T09:36:26.812836+0000","last_clean":"2024-04-25T09:36:26.812836+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:26.812836+0000","last_undegraded":"2024-04-25T09:36:26.812836+0000","last_fullsized":"2024-04-25T09:36:26.812836+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'671","reported_seq":700,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.065636+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:26.065636+0000","last_peered":"2024-04-25T09:36:26.065636+0000","last_clean":"2024-04-25T09:36:26.065636+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:26.065636+0000","last_undegraded":"2024-04-25T09:36:26.065636+0000","last_fullsized":"2024-04-25T09:36:26.065636+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'607","reported_seq":638,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.565502+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:26.565502+0000","last_peered":"2024-04-25T09:36:26.565502+0000","last_clean":"2024-04-25T09:36:26.565502+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:26.565502+0000","last_undegraded":"2024-04-25T09:36:26.565502+0000","last_fullsized":"2024-04-25T09:36:26.565502+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'639","reported_seq":670,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.697782+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:26.697782+0000","last_peered":"2024-04-25T09:36:26.697782+0000","last_clean":"2024-04-25T09:36:26.697782+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:26.697782+0000","last_undegraded":"2024-04-25T09:36:26.697782+0000","last_fullsized":"2024-04-25T09:36:26.697782+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'631","reported_seq":664,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.348606+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:26.348606+0000","last_peered":"2024-04-25T09:36:26.348606+0000","last_clean":"2024-04-25T09:36:26.348606+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:26.348606+0000","last_undegraded":"2024-04-25T09:36:26.348606+0000","last_fullsized":"2024-04-25T09:36:26.348606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'623","reported_seq":656,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:23.535509+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:23.535509+0000","last_peered":"2024-04-25T09:36:23.535509+0000","last_clean":"2024-04-25T09:36:23.535509+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:23.535509+0000","last_undegraded":"2024-04-25T09:36:23.535509+0000","last_fullsized":"2024-04-25T09:36:23.535509+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'655","reported_seq":686,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.478319+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:26.478319+0000","last_peered":"2024-04-25T09:36:26.478319+0000","last_clean":"2024-04-25T09:36:26.478319+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:26.478319+0000","last_undegraded":"2024-04-25T09:36:26.478319+0000","last_fullsized":"2024-04-25T09:36:26.478319+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'599","reported_seq":628,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.386955+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:26.386955+0000","last_peered":"2024-04-25T09:36:26.386955+0000","last_clean":"2024-04-25T09:36:26.386955+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:26.386955+0000","last_undegraded":"2024-04-25T09:36:26.386955+0000","last_fullsized":"2024-04-25T09:36:26.386955+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'771","reported_seq":804,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:27.428364+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:27.428364+0000","last_peered":"2024-04-25T09:36:27.428364+0000","last_clean":"2024-04-25T09:36:27.428364+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:27.428364+0000","last_undegraded":"2024-04-25T09:36:27.428364+0000","last_fullsized":"2024-04-25T09:36:27.428364+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324224,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":772,"num_write_kb":6176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'663","reported_seq":692,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:26.190758+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:26.190758+0000","last_peered":"2024-04-25T09:36:26.190758+0000","last_clean":"2024-04-25T09:36:26.190758+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:26.190758+0000","last_undegraded":"2024-04-25T09:36:26.190758+0000","last_fullsized":"2024-04-25T09:36:26.190758+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'555","reported_seq":586,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:27.458102+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:27.458102+0000","last_peered":"2024-04-25T09:36:27.458102+0000","last_clean":"2024-04-25T09:36:27.458102+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:27.458102+0000","last_undegraded":"2024-04-25T09:36:27.458102+0000","last_fullsized":"2024-04-25T09:36:27.458102+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4554752,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'567","reported_seq":596,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:25.731679+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:25.731679+0000","last_peered":"2024-04-25T09:36:25.731679+0000","last_clean":"2024-04-25T09:36:25.731679+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:25.731679+0000","last_undegraded":"2024-04-25T09:36:25.731679+0000","last_fullsized":"2024-04-25T09:36:25.731679+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'447","reported_seq":480,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:24.366230+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:24.366230+0000","last_peered":"2024-04-25T09:36:24.366230+0000","last_clean":"2024-04-25T09:36:24.366230+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:24.366230+0000","last_undegraded":"2024-04-25T09:36:24.366230+0000","last_fullsized":"2024-04-25T09:36:24.366230+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'503","reported_seq":534,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:25.907966+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:25.907966+0000","last_peered":"2024-04-25T09:36:25.907966+0000","last_clean":"2024-04-25T09:36:25.907966+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:25.907966+0000","last_undegraded":"2024-04-25T09:36:25.907966+0000","last_fullsized":"2024-04-25T09:36:25.907966+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'671","reported_seq":704,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:27.252330+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:27.252330+0000","last_peered":"2024-04-25T09:36:27.252330+0000","last_clean":"2024-04-25T09:36:27.252330+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:27.252330+0000","last_undegraded":"2024-04-25T09:36:27.252330+0000","last_fullsized":"2024-04-25T09:36:27.252330+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'655","reported_seq":688,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:25.022883+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:25.022883+0000","last_peered":"2024-04-25T09:36:25.022883+0000","last_clean":"2024-04-25T09:36:25.022883+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:25.022883+0000","last_undegraded":"2024-04-25T09:36:25.022883+0000","last_fullsized":"2024-04-25T09:36:25.022883+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":81068032,"num_objects":1238,"num_object_clones":0,"num_object_copies":3714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9896,"num_write_kb":79168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":121221120,"data_stored":242442240,"data_compressed":12515355,"data_compressed_allocated":121221120,"data_compressed_original":242442240,"omap_allocated":0,"internal_metadata":0},"log_size":9880,"ondisk_log_size":9880,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122580,"kb_used_data":37452,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94249260,"statfs":{"total":96636764160,"available":96511242240,"internally_reserved":0,"allocated":38350848,"data_stored":76289575,"data_compressed":3927720,"data_compressed_allocated":37793792,"data_compressed_original":76079104,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116392,"kb_used_data":22944,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94255448,"statfs":{"total":96636764160,"available":96517578752,"internally_reserved":0,"allocated":23494656,"data_stored":46577191,"data_compressed":2394003,"data_compressed_allocated":22937600,"data_compressed_original":46366720,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125744,"kb_used_data":32292,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94246096,"statfs":{"total":96636764160,"available":96508002304,"internally_reserved":0,"allocated":33067008,"data_stored":65254407,"data_compressed":3358508,"data_compressed_allocated":32530432,"data_compressed_original":65060864,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116764,"kb_used_data":27476,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94255076,"statfs":{"total":96636764160,"available":96517197824,"internally_reserved":0,"allocated":28135424,"data_stored":55858727,"data_compressed":2872996,"data_compressed_allocated":27578368,"data_compressed_original":55648256,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27656192,"data_stored":55312384,"data_compressed":2855296,"data_compressed_allocated":27656192,"data_compressed_original":55312384,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32706560,"data_stored":65413120,"data_compressed":3376697,"data_compressed_allocated":32706560,"data_compressed_original":65413120,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22978560,"data_stored":45957120,"data_compressed":2372496,"data_compressed_allocated":22978560,"data_compressed_original":45957120,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37879808,"data_stored":75759616,"data_compressed":3910866,"data_compressed_allocated":37879808,"data_compressed_original":75759616,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:30.316 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:30.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:30.445+0000 7fe8a2f1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:30.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:30.451+0000 7fe8a2f1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:30.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 10319 10303 1.0188 1.03125 0.129382 0.1226 2024-04-25T09:36:31.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:36:31.491047+0000 min lat: 0.0148642 max lat: 0.372481 avg lat: 0.122762 2024-04-25T09:36:31.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:36:31.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 16 10432 10416 1.0171 0.882812 0.0417582 0.122762 2024-04-25T09:36:32.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 10553 10537 1.01621 0.945312 0.0518336 0.122841 2024-04-25T09:36:32.681 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:32.799 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:32.811+0000 7f845b55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:32.804 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:32.818+0000 7f845b55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:33.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 10687 10671 1.01658 1.04688 0.112369 0.122856 2024-04-25T09:36:34.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 16 10795 10779 1.0145 0.84375 0.0667117 0.123078 2024-04-25T09:36:34.593 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:34.593 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:34.593 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:36:34.593 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:36:34.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:34.755+0000 7f078e39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:34.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:34.766+0000 7f078e39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:34.797 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:34.800 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:34.800 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:34.800 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:36:34.920 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:34.927+0000 7f05dd55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:34.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:34.938+0000 7f05dd55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:34.944 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:34.945 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:34.947 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:34.947 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:34.947 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:36:35.065 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:35.072+0000 7f2041ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:35.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:35.083+0000 7f2041ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:35.088 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:35.090 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:35.091 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:35.091 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:35.091 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:36:35.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:35.266+0000 7f542e86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:35.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:35.273+0000 7f542e86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:35.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:35.266+0000 7fa6dab9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:35.267 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:35.281+0000 7fa6dab9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:36:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:36:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:36:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:36:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:36:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:36:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:36:35.321 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:36:35.321 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:36:35.321 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:36:35.321 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:36:35.321 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:36:35.323 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:36:35.323 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:36:35.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 10926 10910 1.0146 1.02344 0.167523 0.123097 2024-04-25T09:36:36.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 11051 11035 1.01416 0.976562 0.200936 0.123152 2024-04-25T09:36:37.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 11181 11165 1.01417 1.01562 0.0359276 0.12312 2024-04-25T09:36:37.615 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:37.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:37.767+0000 7fb417a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:37.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:37.774+0000 7fb417a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:38.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 11300 11284 1.0132 0.929688 0.0885376 0.123245 2024-04-25T09:36:39.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 11415 11399 1.01189 0.898438 0.161134 0.123394 2024-04-25T09:36:39.955 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:40.074 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:40.085+0000 7f22f5e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:40.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:40.091+0000 7f22f5e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:40.324 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:40.325 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:40.325 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:40.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:40.479+0000 7feeabc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:40.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:40.489+0000 7feeabc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:40.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 11543 11527 1.01176 1 0.0689118 0.123441 2024-04-25T09:36:40.690 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:40.690 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:40.706 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-04-25T09:36:39.339722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":91693600,"num_objects":1394,"num_object_clones":0,"num_object_copies":4182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11258,"num_write_kb":90862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11202,"ondisk_log_size":11202,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":496216,"kb_used_data":134900,"kb_used_omap":0,"kb_used_meta":361280,"kb_avail":376991144,"statfs":{"total":386547056640,"available":386038931456,"internally_reserved":0,"allocated":138137600,"data_stored":274159228,"data_compressed":14111558,"data_compressed_allocated":135929856,"data_compressed_original":273334272,"omap_allocated":0,"internal_metadata":369950720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13492224,"num_objects":207,"num_object_clones":0,"num_object_copies":621,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1647,"num_write_kb":13176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002707"},"pg_stats":[{"pgid":"7.f","version":"63'695","reported_seq":728,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:37.417998+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:37.417998+0000","last_peered":"2024-04-25T09:36:37.417998+0000","last_clean":"2024-04-25T09:36:37.417998+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:37.417998+0000","last_undegraded":"2024-04-25T09:36:37.417998+0000","last_fullsized":"2024-04-25T09:36:37.417998+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'743","reported_seq":772,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:36.024658+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:36.024658+0000","last_peered":"2024-04-25T09:36:36.024658+0000","last_clean":"2024-04-25T09:36:36.024658+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:36.024658+0000","last_undegraded":"2024-04-25T09:36:36.024658+0000","last_fullsized":"2024-04-25T09:36:36.024658+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'655","reported_seq":686,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:37.370307+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:37.370307+0000","last_peered":"2024-04-25T09:36:37.370307+0000","last_clean":"2024-04-25T09:36:37.370307+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:37.370307+0000","last_undegraded":"2024-04-25T09:36:37.370307+0000","last_fullsized":"2024-04-25T09:36:37.370307+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'697","reported_seq":728,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:37.443475+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:37.443475+0000","last_peered":"2024-04-25T09:36:37.443475+0000","last_clean":"2024-04-25T09:36:37.443475+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:37.443475+0000","last_undegraded":"2024-04-25T09:36:37.443475+0000","last_fullsized":"2024-04-25T09:36:37.443475+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5718016,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":698,"num_write_kb":5584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'695","reported_seq":728,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:36.781497+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:36.781497+0000","last_peered":"2024-04-25T09:36:36.781497+0000","last_clean":"2024-04-25T09:36:36.781497+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:36.781497+0000","last_undegraded":"2024-04-25T09:36:36.781497+0000","last_fullsized":"2024-04-25T09:36:36.781497+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'711","reported_seq":744,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:36.496493+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:36.496493+0000","last_peered":"2024-04-25T09:36:36.496493+0000","last_clean":"2024-04-25T09:36:36.496493+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:36.496493+0000","last_undegraded":"2024-04-25T09:36:36.496493+0000","last_fullsized":"2024-04-25T09:36:36.496493+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'711","reported_seq":742,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:36.317836+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:36.317836+0000","last_peered":"2024-04-25T09:36:36.317836+0000","last_clean":"2024-04-25T09:36:36.317836+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:36.317836+0000","last_undegraded":"2024-04-25T09:36:36.317836+0000","last_fullsized":"2024-04-25T09:36:36.317836+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'703","reported_seq":732,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:36.343981+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:36.343981+0000","last_peered":"2024-04-25T09:36:36.343981+0000","last_clean":"2024-04-25T09:36:36.343981+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:36.343981+0000","last_undegraded":"2024-04-25T09:36:36.343981+0000","last_fullsized":"2024-04-25T09:36:36.343981+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'839","reported_seq":872,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:37.064709+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:37.064709+0000","last_peered":"2024-04-25T09:36:37.064709+0000","last_clean":"2024-04-25T09:36:37.064709+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:37.064709+0000","last_undegraded":"2024-04-25T09:36:37.064709+0000","last_fullsized":"2024-04-25T09:36:37.064709+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'727","reported_seq":756,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:35.744211+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:35.744211+0000","last_peered":"2024-04-25T09:36:35.744211+0000","last_clean":"2024-04-25T09:36:35.744211+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:35.744211+0000","last_undegraded":"2024-04-25T09:36:35.744211+0000","last_fullsized":"2024-04-25T09:36:35.744211+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'647","reported_seq":678,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:35.893092+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:35.893092+0000","last_peered":"2024-04-25T09:36:35.893092+0000","last_clean":"2024-04-25T09:36:35.893092+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:35.893092+0000","last_undegraded":"2024-04-25T09:36:35.893092+0000","last_fullsized":"2024-04-25T09:36:35.893092+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'673","reported_seq":702,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:36.417733+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:36.417733+0000","last_peered":"2024-04-25T09:36:36.417733+0000","last_clean":"2024-04-25T09:36:36.417733+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:36.417733+0000","last_undegraded":"2024-04-25T09:36:36.417733+0000","last_fullsized":"2024-04-25T09:36:36.417733+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5521408,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":674,"num_write_kb":5392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'543","reported_seq":576,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:35.489376+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:35.489376+0000","last_peered":"2024-04-25T09:36:35.489376+0000","last_clean":"2024-04-25T09:36:35.489376+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:35.489376+0000","last_undegraded":"2024-04-25T09:36:35.489376+0000","last_fullsized":"2024-04-25T09:36:35.489376+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'543","reported_seq":574,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:37.187110+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:37.187110+0000","last_peered":"2024-04-25T09:36:37.187110+0000","last_clean":"2024-04-25T09:36:37.187110+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:37.187110+0000","last_undegraded":"2024-04-25T09:36:37.187110+0000","last_fullsized":"2024-04-25T09:36:37.187110+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'775","reported_seq":808,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:35.783356+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:35.783356+0000","last_peered":"2024-04-25T09:36:35.783356+0000","last_clean":"2024-04-25T09:36:35.783356+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:35.783356+0000","last_undegraded":"2024-04-25T09:36:35.783356+0000","last_fullsized":"2024-04-25T09:36:35.783356+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'748","reported_seq":781,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:37.449949+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:37.449949+0000","last_peered":"2024-04-25T09:36:37.449949+0000","last_clean":"2024-04-25T09:36:37.449949+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:37.449949+0000","last_undegraded":"2024-04-25T09:36:37.449949+0000","last_fullsized":"2024-04-25T09:36:37.449949+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6135808,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":5992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":91103232,"num_objects":1392,"num_object_clones":0,"num_object_copies":4176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11121,"num_write_kb":88968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":136380416,"data_stored":272760832,"data_compressed":14080877,"data_compressed_allocated":136380416,"data_compressed_original":272760832,"omap_allocated":0,"internal_metadata":0},"log_size":11105,"ondisk_log_size":11105,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131384,"kb_used_data":42092,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94240456,"statfs":{"total":96636764160,"available":96502226944,"internally_reserved":0,"allocated":43102208,"data_stored":85792295,"data_compressed":4418399,"data_compressed_allocated":42545152,"data_compressed_original":85581824,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106392,"kb_used_data":25424,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94265448,"statfs":{"total":96636764160,"available":96527818752,"internally_reserved":0,"allocated":26034176,"data_stored":51656231,"data_compressed":2656263,"data_compressed_allocated":25477120,"data_compressed_original":51445760,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133600,"kb_used_data":35992,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94238240,"statfs":{"total":96636764160,"available":96499957760,"internally_reserved":0,"allocated":36855808,"data_stored":72832007,"data_compressed":3749783,"data_compressed_allocated":36319232,"data_compressed_original":72638464,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124840,"kb_used_data":31392,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94247000,"statfs":{"total":96636764160,"available":96508928000,"internally_reserved":0,"allocated":32145408,"data_stored":63878695,"data_compressed":3287113,"data_compressed_allocated":31588352,"data_compressed_original":63668224,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31686656,"data_stored":63373312,"data_compressed":3271528,"data_compressed_allocated":31686656,"data_compressed_original":63373312,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36466688,"data_stored":72933376,"data_compressed":3765011,"data_compressed_allocated":36466688,"data_compressed_original":72933376,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25567232,"data_stored":51134464,"data_compressed":2639832,"data_compressed_allocated":25567232,"data_compressed_original":51134464,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42659840,"data_stored":85319680,"data_compressed":4404506,"data_compressed_allocated":42659840,"data_compressed_original":85319680,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:41.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 16 11652 11636 1.00998 0.851562 0.0558856 0.123636 2024-04-25T09:36:42.370 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:42.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1108 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 11652 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.01021 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.0787566 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.17969 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.835938 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 129 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 10.0808 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 151 2024-04-25T09:36:42.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 107 2024-04-25T09:36:42.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.123662 2024-04-25T09:36:42.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.0591525 2024-04-25T09:36:42.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.372481 2024-04-25T09:36:42.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0148642 2024-04-25T09:36:42.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:42.497+0000 7f227ec2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:42.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:42.503+0000 7f227ec2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:42.503 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:36:44.957 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:45.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:45.090+0000 7fe47d95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:45.084 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:45.097+0000 7fe47d95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:45.709 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:45.709 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:45.710 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:45.836 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:45.844+0000 7fab3966d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:45.840 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:45.854+0000 7fab3966d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:46.175 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:46.175 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:46.197 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-04-25T09:36:45.341003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96002592,"num_objects":1459,"num_object_clones":0,"num_object_copies":4377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11784,"num_write_kb":95070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11728,"ondisk_log_size":11728,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":490616,"kb_used_data":141784,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":376996744,"statfs":{"total":386547056640,"available":386044665856,"internally_reserved":0,"allocated":145186816,"data_stored":288257660,"data_compressed":14839539,"data_compressed_allocated":142979072,"data_compressed_original":287432704,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9371648,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002638"},"pg_stats":[{"pgid":"7.f","version":"63'731","reported_seq":764,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:41.523162+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:41.523162+0000","last_peered":"2024-04-25T09:36:41.523162+0000","last_clean":"2024-04-25T09:36:41.523162+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:41.523162+0000","last_undegraded":"2024-04-25T09:36:41.523162+0000","last_fullsized":"2024-04-25T09:36:41.523162+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5996544,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":5856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'794","reported_seq":823,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:41.428159+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:41.428159+0000","last_peered":"2024-04-25T09:36:41.428159+0000","last_clean":"2024-04-25T09:36:41.428159+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:41.428159+0000","last_undegraded":"2024-04-25T09:36:41.428159+0000","last_fullsized":"2024-04-25T09:36:41.428159+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6512640,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":6360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'695","reported_seq":726,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:41.396622+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:41.396622+0000","last_peered":"2024-04-25T09:36:41.396622+0000","last_clean":"2024-04-25T09:36:41.396622+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:41.396622+0000","last_undegraded":"2024-04-25T09:36:41.396622+0000","last_fullsized":"2024-04-25T09:36:41.396622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'703","reported_seq":734,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:37.629371+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:37.629371+0000","last_peered":"2024-04-25T09:36:37.629371+0000","last_clean":"2024-04-25T09:36:37.629371+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:37.629371+0000","last_undegraded":"2024-04-25T09:36:37.629371+0000","last_fullsized":"2024-04-25T09:36:37.629371+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'735","reported_seq":768,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:41.481212+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:41.481212+0000","last_peered":"2024-04-25T09:36:41.481212+0000","last_clean":"2024-04-25T09:36:41.481212+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:41.481212+0000","last_undegraded":"2024-04-25T09:36:41.481212+0000","last_fullsized":"2024-04-25T09:36:41.481212+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'735","reported_seq":768,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:40.024932+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:40.024932+0000","last_peered":"2024-04-25T09:36:40.024932+0000","last_clean":"2024-04-25T09:36:40.024932+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:40.024932+0000","last_undegraded":"2024-04-25T09:36:40.024932+0000","last_fullsized":"2024-04-25T09:36:40.024932+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'751","reported_seq":782,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:40.517705+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:40.517705+0000","last_peered":"2024-04-25T09:36:40.517705+0000","last_clean":"2024-04-25T09:36:40.517705+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:40.517705+0000","last_undegraded":"2024-04-25T09:36:40.517705+0000","last_fullsized":"2024-04-25T09:36:40.517705+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'735","reported_seq":764,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:41.188606+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:41.188606+0000","last_peered":"2024-04-25T09:36:41.188606+0000","last_clean":"2024-04-25T09:36:41.188606+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:41.188606+0000","last_undegraded":"2024-04-25T09:36:41.188606+0000","last_fullsized":"2024-04-25T09:36:41.188606+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'863","reported_seq":896,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:40.324654+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:40.324654+0000","last_peered":"2024-04-25T09:36:40.324654+0000","last_clean":"2024-04-25T09:36:40.324654+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:40.324654+0000","last_undegraded":"2024-04-25T09:36:40.324654+0000","last_fullsized":"2024-04-25T09:36:40.324654+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":863,"log_dups_size":0,"ondisk_log_size":863,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'767","reported_seq":796,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:40.763067+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:40.763067+0000","last_peered":"2024-04-25T09:36:40.763067+0000","last_clean":"2024-04-25T09:36:40.763067+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:40.763067+0000","last_undegraded":"2024-04-25T09:36:40.763067+0000","last_fullsized":"2024-04-25T09:36:40.763067+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'679","reported_seq":710,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:39.628275+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:39.628275+0000","last_peered":"2024-04-25T09:36:39.628275+0000","last_clean":"2024-04-25T09:36:39.628275+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:39.628275+0000","last_undegraded":"2024-04-25T09:36:39.628275+0000","last_fullsized":"2024-04-25T09:36:39.628275+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'695","reported_seq":724,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:40.537292+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:40.537292+0000","last_peered":"2024-04-25T09:36:40.537292+0000","last_clean":"2024-04-25T09:36:40.537292+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:40.537292+0000","last_undegraded":"2024-04-25T09:36:40.537292+0000","last_fullsized":"2024-04-25T09:36:40.537292+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'567","reported_seq":600,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:40.484194+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:40.484194+0000","last_peered":"2024-04-25T09:36:40.484194+0000","last_clean":"2024-04-25T09:36:40.484194+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:40.484194+0000","last_undegraded":"2024-04-25T09:36:40.484194+0000","last_fullsized":"2024-04-25T09:36:40.484194+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'623","reported_seq":654,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:41.551715+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:41.551715+0000","last_peered":"2024-04-25T09:36:41.551715+0000","last_clean":"2024-04-25T09:36:41.551715+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:41.551715+0000","last_undegraded":"2024-04-25T09:36:41.551715+0000","last_fullsized":"2024-04-25T09:36:41.551715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'799","reported_seq":832,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:39.562721+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:39.562721+0000","last_peered":"2024-04-25T09:36:39.562721+0000","last_clean":"2024-04-25T09:36:39.562721+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:39.562721+0000","last_undegraded":"2024-04-25T09:36:39.562721+0000","last_fullsized":"2024-04-25T09:36:39.562721+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'759","reported_seq":792,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:39.918574+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:39.918574+0000","last_peered":"2024-04-25T09:36:39.918574+0000","last_clean":"2024-04-25T09:36:39.918574+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:39.918574+0000","last_undegraded":"2024-04-25T09:36:39.918574+0000","last_fullsized":"2024-04-25T09:36:39.918574+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":95412224,"num_objects":1457,"num_object_clones":0,"num_object_copies":4371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11647,"num_write_kb":93176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143089664,"data_stored":286179328,"data_compressed":14773749,"data_compressed_allocated":143089664,"data_compressed_original":286179328,"omap_allocated":0,"internal_metadata":0},"log_size":11631,"ondisk_log_size":11631,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133280,"kb_used_data":43992,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94238560,"statfs":{"total":96636764160,"available":96500285440,"internally_reserved":0,"allocated":45047808,"data_stored":89683495,"data_compressed":4619324,"data_compressed_allocated":44490752,"data_compressed_original":89473024,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107792,"kb_used_data":26824,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264048,"statfs":{"total":96636764160,"available":96526385152,"internally_reserved":0,"allocated":27467776,"data_stored":54523431,"data_compressed":2804313,"data_compressed_allocated":26910720,"data_compressed_original":54312960,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":119020,"kb_used_data":38052,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94252820,"statfs":{"total":96636764160,"available":96514887680,"internally_reserved":0,"allocated":38965248,"data_stored":77050887,"data_compressed":3967627,"data_compressed_allocated":38428672,"data_compressed_original":76857344,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130524,"kb_used_data":32916,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94241316,"statfs":{"total":96636764160,"available":96503107584,"internally_reserved":0,"allocated":33705984,"data_stored":66999847,"data_compressed":3448275,"data_compressed_allocated":33148928,"data_compressed_original":66789376,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33177600,"data_stored":66355200,"data_compressed":3425499,"data_compressed_allocated":33177600,"data_compressed_original":66355200,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38592512,"data_stored":77185024,"data_compressed":3984547,"data_compressed_allocated":38592512,"data_compressed_original":77185024,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26869760,"data_stored":53739520,"data_compressed":2774346,"data_compressed_allocated":26869760,"data_compressed_original":53739520,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44449792,"data_stored":88899584,"data_compressed":4589357,"data_compressed_allocated":44449792,"data_compressed_original":88899584,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:47.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:47.611 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:47.622+0000 7f54bf75d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:47.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:47.629+0000 7f54bf75d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:49.924 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:50.044 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:50.054+0000 7fe9db39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:50.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:50.062+0000 7fe9db39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:51.199 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:36:51.200 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:36:51.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:51.331+0000 7f83a93d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:51.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:51.346+0000 7f83a93d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:52.351 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:36:52.368 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:36:52.379 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:52.505 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:52.506+0000 7f3f55a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:52.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:52.527+0000 7f3f55a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:52.557 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:52.567+0000 7fc5c386d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:52.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:52.576+0000 7fc5c386d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:53.357 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1457 objects 2024-04-25T09:36:53.357 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :10.8528 2024-04-25T09:36:53.357 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:36:53.373 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:36:53.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:53.509+0000 7f2df039d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:53.506 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:53.519+0000 7f2df039d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:54.361 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:36:54.377 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:36:54.489 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:54.496+0000 7fe5bd19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:54.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:54.505+0000 7fe5bd19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.087 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:55.112 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-04-25T09:36:55.113 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-04-25T09:36:55.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.206+0000 7fe7e462d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.213+0000 7fe7e462d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.250 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.254+0000 7f8d50c64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.267+0000 7f8d50c64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.371 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:36:55.392 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:36:55.393 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:55.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.513+0000 7fda1eb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.507 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.520+0000 7fda1eb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.694 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:55.694 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:55.707 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-04-25T09:36:55.385731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11371064,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":13082,"num_write_kb":95111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13026,"ondisk_log_size":13026,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":372960,"kb_used_data":24064,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":377114400,"statfs":{"total":386547056640,"available":386165145600,"internally_reserved":0,"allocated":24641536,"data_stored":47142596,"data_compressed":2392710,"data_compressed_allocated":22421504,"data_compressed_original":46317568,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42663936,"num_objects":-651,"num_object_clones":0,"num_object_copies":-1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.043469"},"pg_stats":[{"pgid":"7.f","version":"63'815","reported_seq":848,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.390288+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:52.390288+0000","last_peered":"2024-04-25T09:36:52.390288+0000","last_clean":"2024-04-25T09:36:52.390288+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:52.390288+0000","last_undegraded":"2024-04-25T09:36:52.390288+0000","last_fullsized":"2024-04-25T09:36:52.390288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491520,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":5856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'881","reported_seq":910,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.198355+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:51.198355+0000","last_peered":"2024-04-25T09:36:51.198355+0000","last_clean":"2024-04-25T09:36:51.198355+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:51.198355+0000","last_undegraded":"2024-04-25T09:36:51.198355+0000","last_fullsized":"2024-04-25T09:36:51.198355+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":882,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'775","reported_seq":807,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.966468+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:51.966468+0000","last_peered":"2024-04-25T09:36:51.966468+0000","last_clean":"2024-04-25T09:36:51.966468+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:51.966468+0000","last_undegraded":"2024-04-25T09:36:51.966468+0000","last_fullsized":"2024-04-25T09:36:51.966468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524312,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":776,"num_write_kb":5569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'788","reported_seq":819,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.216646+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:52.216646+0000","last_peered":"2024-04-25T09:36:52.216646+0000","last_clean":"2024-04-25T09:36:52.216646+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:52.216646+0000","last_undegraded":"2024-04-25T09:36:52.216646+0000","last_fullsized":"2024-04-25T09:36:52.216646+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'817","reported_seq":850,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.112667+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:52.112667+0000","last_peered":"2024-04-25T09:36:52.112667+0000","last_clean":"2024-04-25T09:36:52.112667+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:52.112667+0000","last_undegraded":"2024-04-25T09:36:52.112667+0000","last_fullsized":"2024-04-25T09:36:52.112667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'818","reported_seq":851,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.963398+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:51.963398+0000","last_peered":"2024-04-25T09:36:51.963398+0000","last_clean":"2024-04-25T09:36:51.963398+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:51.963398+0000","last_undegraded":"2024-04-25T09:36:51.963398+0000","last_fullsized":"2024-04-25T09:36:51.963398+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":819,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'837","reported_seq":868,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.108528+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:52.108528+0000","last_peered":"2024-04-25T09:36:52.108528+0000","last_clean":"2024-04-25T09:36:52.108528+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:52.108528+0000","last_undegraded":"2024-04-25T09:36:52.108528+0000","last_fullsized":"2024-04-25T09:36:52.108528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'809","reported_seq":838,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.336863+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:51.336863+0000","last_peered":"2024-04-25T09:36:51.336863+0000","last_clean":"2024-04-25T09:36:51.336863+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:51.336863+0000","last_undegraded":"2024-04-25T09:36:51.336863+0000","last_fullsized":"2024-04-25T09:36:51.336863+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":810,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'967","reported_seq":1000,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.089648+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:52.089648+0000","last_peered":"2024-04-25T09:36:52.089648+0000","last_clean":"2024-04-25T09:36:52.089648+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:52.089648+0000","last_undegraded":"2024-04-25T09:36:52.089648+0000","last_fullsized":"2024-04-25T09:36:52.089648+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'848","reported_seq":877,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.320994+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:51.320994+0000","last_peered":"2024-04-25T09:36:51.320994+0000","last_clean":"2024-04-25T09:36:51.320994+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:51.320994+0000","last_undegraded":"2024-04-25T09:36:51.320994+0000","last_fullsized":"2024-04-25T09:36:51.320994+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'755","reported_seq":786,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.353048+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:52.353048+0000","last_peered":"2024-04-25T09:36:52.353048+0000","last_clean":"2024-04-25T09:36:52.353048+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:52.353048+0000","last_undegraded":"2024-04-25T09:36:52.353048+0000","last_fullsized":"2024-04-25T09:36:52.353048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'765","reported_seq":794,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.242798+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:51.242798+0000","last_peered":"2024-04-25T09:36:51.242798+0000","last_clean":"2024-04-25T09:36:51.242798+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:51.242798+0000","last_undegraded":"2024-04-25T09:36:51.242798+0000","last_fullsized":"2024-04-25T09:36:51.242798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'623","reported_seq":656,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.319556+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:51.319556+0000","last_peered":"2024-04-25T09:36:51.319556+0000","last_clean":"2024-04-25T09:36:51.319556+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:51.319556+0000","last_undegraded":"2024-04-25T09:36:51.319556+0000","last_fullsized":"2024-04-25T09:36:51.319556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'689","reported_seq":720,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.193484+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:52.193484+0000","last_peered":"2024-04-25T09:36:52.193484+0000","last_clean":"2024-04-25T09:36:52.193484+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:52.193484+0000","last_undegraded":"2024-04-25T09:36:52.193484+0000","last_fullsized":"2024-04-25T09:36:52.193484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":690,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'894","reported_seq":927,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.267366+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:52.267366+0000","last_peered":"2024-04-25T09:36:52.267366+0000","last_clean":"2024-04-25T09:36:52.267366+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:52.267366+0000","last_undegraded":"2024-04-25T09:36:52.267366+0000","last_fullsized":"2024-04-25T09:36:52.267366+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":895,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'848","reported_seq":881,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.312223+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:52.312223+0000","last_peered":"2024-04-25T09:36:52.312223+0000","last_clean":"2024-04-25T09:36:52.312223+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:52.312223+0000","last_undegraded":"2024-04-25T09:36:52.312223+0000","last_fullsized":"2024-04-25T09:36:52.312223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":10780696,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12945,"num_write_kb":93217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18247680,"data_stored":36470856,"data_compressed":1883193,"data_compressed_allocated":18235392,"data_compressed_original":36470784,"omap_allocated":0,"internal_metadata":0},"log_size":12929,"ondisk_log_size":12929,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102788,"kb_used_data":5148,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94269052,"statfs":{"total":96636764160,"available":96531509248,"internally_reserved":0,"allocated":5271552,"data_stored":10122815,"data_compressed":512186,"data_compressed_allocated":4710400,"data_compressed_original":9912320,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88724,"kb_used_data":3596,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94283116,"statfs":{"total":96636764160,"available":96545910784,"internally_reserved":0,"allocated":3682304,"data_stored":6944319,"data_compressed":348063,"data_compressed_allocated":3121152,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93096,"kb_used_data":7968,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94278744,"statfs":{"total":96636764160,"available":96541433856,"internally_reserved":0,"allocated":8159232,"data_stored":15430687,"data_compressed":786779,"data_compressed_allocated":7618560,"data_compressed_original":15237120,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88352,"kb_used_data":7352,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94283488,"statfs":{"total":96636764160,"available":96546291712,"internally_reserved":0,"allocated":7528448,"data_stored":14644775,"data_compressed":745682,"data_compressed_allocated":6971392,"data_compressed_original":14434304,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":11829248,"data_compressed":610811,"data_compressed_allocated":5914624,"data_compressed_original":11829248,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6475776,"data_stored":12943384,"data_compressed":668339,"data_compressed_allocated":6471680,"data_compressed_original":12943360,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2297856,"data_stored":4587544,"data_compressed":236880,"data_compressed_allocated":2293760,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3559424,"data_stored":7110680,"data_compressed":367163,"data_compressed_allocated":3555328,"data_compressed_original":7110656,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:55.708 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:55.815 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.824+0000 7fd35295d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:55.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:55.831+0000 7fd35295d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:56.002 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:56.003 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:56.015 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-04-25T09:36:55.385731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11371064,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":13082,"num_write_kb":95111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13026,"ondisk_log_size":13026,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":372960,"kb_used_data":24064,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":377114400,"statfs":{"total":386547056640,"available":386165145600,"internally_reserved":0,"allocated":24641536,"data_stored":47142596,"data_compressed":2392710,"data_compressed_allocated":22421504,"data_compressed_original":46317568,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42663936,"num_objects":-651,"num_object_clones":0,"num_object_copies":-1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.043469"},"pg_stats":[{"pgid":"7.f","version":"63'815","reported_seq":848,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.390288+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:52.390288+0000","last_peered":"2024-04-25T09:36:52.390288+0000","last_clean":"2024-04-25T09:36:52.390288+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:52.390288+0000","last_undegraded":"2024-04-25T09:36:52.390288+0000","last_fullsized":"2024-04-25T09:36:52.390288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491520,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":5856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'881","reported_seq":910,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.198355+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:51.198355+0000","last_peered":"2024-04-25T09:36:51.198355+0000","last_clean":"2024-04-25T09:36:51.198355+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:51.198355+0000","last_undegraded":"2024-04-25T09:36:51.198355+0000","last_fullsized":"2024-04-25T09:36:51.198355+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":882,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'775","reported_seq":807,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.966468+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:51.966468+0000","last_peered":"2024-04-25T09:36:51.966468+0000","last_clean":"2024-04-25T09:36:51.966468+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:51.966468+0000","last_undegraded":"2024-04-25T09:36:51.966468+0000","last_fullsized":"2024-04-25T09:36:51.966468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524312,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":776,"num_write_kb":5569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'788","reported_seq":819,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.216646+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:52.216646+0000","last_peered":"2024-04-25T09:36:52.216646+0000","last_clean":"2024-04-25T09:36:52.216646+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:52.216646+0000","last_undegraded":"2024-04-25T09:36:52.216646+0000","last_fullsized":"2024-04-25T09:36:52.216646+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'817","reported_seq":850,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.112667+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:52.112667+0000","last_peered":"2024-04-25T09:36:52.112667+0000","last_clean":"2024-04-25T09:36:52.112667+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:52.112667+0000","last_undegraded":"2024-04-25T09:36:52.112667+0000","last_fullsized":"2024-04-25T09:36:52.112667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'818","reported_seq":851,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.963398+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:51.963398+0000","last_peered":"2024-04-25T09:36:51.963398+0000","last_clean":"2024-04-25T09:36:51.963398+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:51.963398+0000","last_undegraded":"2024-04-25T09:36:51.963398+0000","last_fullsized":"2024-04-25T09:36:51.963398+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":819,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'837","reported_seq":868,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.108528+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:52.108528+0000","last_peered":"2024-04-25T09:36:52.108528+0000","last_clean":"2024-04-25T09:36:52.108528+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:52.108528+0000","last_undegraded":"2024-04-25T09:36:52.108528+0000","last_fullsized":"2024-04-25T09:36:52.108528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'809","reported_seq":838,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.336863+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:51.336863+0000","last_peered":"2024-04-25T09:36:51.336863+0000","last_clean":"2024-04-25T09:36:51.336863+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:51.336863+0000","last_undegraded":"2024-04-25T09:36:51.336863+0000","last_fullsized":"2024-04-25T09:36:51.336863+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":810,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'967","reported_seq":1000,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.089648+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:52.089648+0000","last_peered":"2024-04-25T09:36:52.089648+0000","last_clean":"2024-04-25T09:36:52.089648+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:52.089648+0000","last_undegraded":"2024-04-25T09:36:52.089648+0000","last_fullsized":"2024-04-25T09:36:52.089648+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'848","reported_seq":877,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.320994+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:51.320994+0000","last_peered":"2024-04-25T09:36:51.320994+0000","last_clean":"2024-04-25T09:36:51.320994+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:51.320994+0000","last_undegraded":"2024-04-25T09:36:51.320994+0000","last_fullsized":"2024-04-25T09:36:51.320994+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'755","reported_seq":786,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.353048+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:52.353048+0000","last_peered":"2024-04-25T09:36:52.353048+0000","last_clean":"2024-04-25T09:36:52.353048+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:52.353048+0000","last_undegraded":"2024-04-25T09:36:52.353048+0000","last_fullsized":"2024-04-25T09:36:52.353048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'765","reported_seq":794,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.242798+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:51.242798+0000","last_peered":"2024-04-25T09:36:51.242798+0000","last_clean":"2024-04-25T09:36:51.242798+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:51.242798+0000","last_undegraded":"2024-04-25T09:36:51.242798+0000","last_fullsized":"2024-04-25T09:36:51.242798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'623","reported_seq":656,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.319556+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:51.319556+0000","last_peered":"2024-04-25T09:36:51.319556+0000","last_clean":"2024-04-25T09:36:51.319556+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:51.319556+0000","last_undegraded":"2024-04-25T09:36:51.319556+0000","last_fullsized":"2024-04-25T09:36:51.319556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'689","reported_seq":720,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.193484+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:52.193484+0000","last_peered":"2024-04-25T09:36:52.193484+0000","last_clean":"2024-04-25T09:36:52.193484+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:52.193484+0000","last_undegraded":"2024-04-25T09:36:52.193484+0000","last_fullsized":"2024-04-25T09:36:52.193484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":690,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'894","reported_seq":927,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.267366+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:52.267366+0000","last_peered":"2024-04-25T09:36:52.267366+0000","last_clean":"2024-04-25T09:36:52.267366+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:52.267366+0000","last_undegraded":"2024-04-25T09:36:52.267366+0000","last_fullsized":"2024-04-25T09:36:52.267366+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":895,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'848","reported_seq":881,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.312223+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:52.312223+0000","last_peered":"2024-04-25T09:36:52.312223+0000","last_clean":"2024-04-25T09:36:52.312223+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:52.312223+0000","last_undegraded":"2024-04-25T09:36:52.312223+0000","last_fullsized":"2024-04-25T09:36:52.312223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":10780696,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12945,"num_write_kb":93217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18247680,"data_stored":36470856,"data_compressed":1883193,"data_compressed_allocated":18235392,"data_compressed_original":36470784,"omap_allocated":0,"internal_metadata":0},"log_size":12929,"ondisk_log_size":12929,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102788,"kb_used_data":5148,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94269052,"statfs":{"total":96636764160,"available":96531509248,"internally_reserved":0,"allocated":5271552,"data_stored":10122815,"data_compressed":512186,"data_compressed_allocated":4710400,"data_compressed_original":9912320,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88724,"kb_used_data":3596,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94283116,"statfs":{"total":96636764160,"available":96545910784,"internally_reserved":0,"allocated":3682304,"data_stored":6944319,"data_compressed":348063,"data_compressed_allocated":3121152,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93096,"kb_used_data":7968,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94278744,"statfs":{"total":96636764160,"available":96541433856,"internally_reserved":0,"allocated":8159232,"data_stored":15430687,"data_compressed":786779,"data_compressed_allocated":7618560,"data_compressed_original":15237120,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88352,"kb_used_data":7352,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94283488,"statfs":{"total":96636764160,"available":96546291712,"internally_reserved":0,"allocated":7528448,"data_stored":14644775,"data_compressed":745682,"data_compressed_allocated":6971392,"data_compressed_original":14434304,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":11829248,"data_compressed":610811,"data_compressed_allocated":5914624,"data_compressed_original":11829248,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6475776,"data_stored":12943384,"data_compressed":668339,"data_compressed_allocated":6471680,"data_compressed_original":12943360,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2297856,"data_stored":4587544,"data_compressed":236880,"data_compressed_allocated":2293760,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3559424,"data_stored":7110680,"data_compressed":367163,"data_compressed_allocated":3555328,"data_compressed_original":7110656,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:56.016 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:36:56.016 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:36:56.016 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:36:56.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:56.132+0000 7f7db795d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:56.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:56.140+0000 7f7db795d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:56.313 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:36:56.313 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:36:56.325 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-04-25T09:36:55.385731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11371064,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":13082,"num_write_kb":95111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13026,"ondisk_log_size":13026,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":372960,"kb_used_data":24064,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":377114400,"statfs":{"total":386547056640,"available":386165145600,"internally_reserved":0,"allocated":24641536,"data_stored":47142596,"data_compressed":2392710,"data_compressed_allocated":22421504,"data_compressed_original":46317568,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42663936,"num_objects":-651,"num_object_clones":0,"num_object_copies":-1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.043469"},"pg_stats":[{"pgid":"7.f","version":"63'815","reported_seq":848,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.390288+0000","last_change":"2024-04-25T09:35:10.559734+0000","last_active":"2024-04-25T09:36:52.390288+0000","last_peered":"2024-04-25T09:36:52.390288+0000","last_clean":"2024-04-25T09:36:52.390288+0000","last_became_active":"2024-04-25T09:35:10.549973+0000","last_became_peered":"2024-04-25T09:35:10.549973+0000","last_unstale":"2024-04-25T09:36:52.390288+0000","last_undegraded":"2024-04-25T09:36:52.390288+0000","last_fullsized":"2024-04-25T09:36:52.390288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":491520,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":5856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"63'881","reported_seq":910,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.198355+0000","last_change":"2024-04-25T09:35:10.595096+0000","last_active":"2024-04-25T09:36:51.198355+0000","last_peered":"2024-04-25T09:36:51.198355+0000","last_clean":"2024-04-25T09:36:51.198355+0000","last_became_active":"2024-04-25T09:35:10.583086+0000","last_became_peered":"2024-04-25T09:35:10.583086+0000","last_unstale":"2024-04-25T09:36:51.198355+0000","last_undegraded":"2024-04-25T09:36:51.198355+0000","last_fullsized":"2024-04-25T09:36:51.198355+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":882,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"63'775","reported_seq":807,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.966468+0000","last_change":"2024-04-25T09:35:10.554978+0000","last_active":"2024-04-25T09:36:51.966468+0000","last_peered":"2024-04-25T09:36:51.966468+0000","last_clean":"2024-04-25T09:36:51.966468+0000","last_became_active":"2024-04-25T09:35:10.546273+0000","last_became_peered":"2024-04-25T09:35:10.546273+0000","last_unstale":"2024-04-25T09:36:51.966468+0000","last_undegraded":"2024-04-25T09:36:51.966468+0000","last_fullsized":"2024-04-25T09:36:51.966468+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524312,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":776,"num_write_kb":5569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"63'788","reported_seq":819,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.216646+0000","last_change":"2024-04-25T09:35:10.550672+0000","last_active":"2024-04-25T09:36:52.216646+0000","last_peered":"2024-04-25T09:36:52.216646+0000","last_clean":"2024-04-25T09:36:52.216646+0000","last_became_active":"2024-04-25T09:35:10.540501+0000","last_became_peered":"2024-04-25T09:35:10.540501+0000","last_unstale":"2024-04-25T09:36:52.216646+0000","last_undegraded":"2024-04-25T09:36:52.216646+0000","last_fullsized":"2024-04-25T09:36:52.216646+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196608,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"63'817","reported_seq":850,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.112667+0000","last_change":"2024-04-25T09:35:10.585562+0000","last_active":"2024-04-25T09:36:52.112667+0000","last_peered":"2024-04-25T09:36:52.112667+0000","last_clean":"2024-04-25T09:36:52.112667+0000","last_became_active":"2024-04-25T09:35:10.578070+0000","last_became_peered":"2024-04-25T09:35:10.578070+0000","last_unstale":"2024-04-25T09:36:52.112667+0000","last_undegraded":"2024-04-25T09:36:52.112667+0000","last_fullsized":"2024-04-25T09:36:52.112667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":818,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"63'818","reported_seq":851,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.963398+0000","last_change":"2024-04-25T09:35:10.620299+0000","last_active":"2024-04-25T09:36:51.963398+0000","last_peered":"2024-04-25T09:36:51.963398+0000","last_clean":"2024-04-25T09:36:51.963398+0000","last_became_active":"2024-04-25T09:35:10.610769+0000","last_became_peered":"2024-04-25T09:35:10.610769+0000","last_unstale":"2024-04-25T09:36:51.963398+0000","last_undegraded":"2024-04-25T09:36:51.963398+0000","last_fullsized":"2024-04-25T09:36:51.963398+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":819,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"63'837","reported_seq":868,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.108528+0000","last_change":"2024-04-25T09:35:10.526716+0000","last_active":"2024-04-25T09:36:52.108528+0000","last_peered":"2024-04-25T09:36:52.108528+0000","last_clean":"2024-04-25T09:36:52.108528+0000","last_became_active":"2024-04-25T09:35:10.516393+0000","last_became_peered":"2024-04-25T09:35:10.516393+0000","last_unstale":"2024-04-25T09:36:52.108528+0000","last_undegraded":"2024-04-25T09:36:52.108528+0000","last_fullsized":"2024-04-25T09:36:52.108528+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"63'809","reported_seq":838,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.336863+0000","last_change":"2024-04-25T09:35:10.592752+0000","last_active":"2024-04-25T09:36:51.336863+0000","last_peered":"2024-04-25T09:36:51.336863+0000","last_clean":"2024-04-25T09:36:51.336863+0000","last_became_active":"2024-04-25T09:35:10.578921+0000","last_became_peered":"2024-04-25T09:35:10.578921+0000","last_unstale":"2024-04-25T09:36:51.336863+0000","last_undegraded":"2024-04-25T09:36:51.336863+0000","last_fullsized":"2024-04-25T09:36:51.336863+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":810,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"63'967","reported_seq":1000,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.089648+0000","last_change":"2024-04-25T09:35:10.653029+0000","last_active":"2024-04-25T09:36:52.089648+0000","last_peered":"2024-04-25T09:36:52.089648+0000","last_clean":"2024-04-25T09:36:52.089648+0000","last_became_active":"2024-04-25T09:35:10.646404+0000","last_became_peered":"2024-04-25T09:35:10.646404+0000","last_unstale":"2024-04-25T09:36:52.089648+0000","last_undegraded":"2024-04-25T09:36:52.089648+0000","last_fullsized":"2024-04-25T09:36:52.089648+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":967,"log_dups_size":0,"ondisk_log_size":967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":273,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.528086+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:35:58.528086+0000","last_peered":"2024-04-25T09:35:58.528086+0000","last_clean":"2024-04-25T09:35:58.528086+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:35:58.528086+0000","last_undegraded":"2024-04-25T09:35:58.528086+0000","last_fullsized":"2024-04-25T09:35:58.528086+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.507308+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:35:58.507308+0000","last_peered":"2024-04-25T09:35:58.507308+0000","last_clean":"2024-04-25T09:35:58.507308+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:35:58.507308+0000","last_undegraded":"2024-04-25T09:35:58.507308+0000","last_fullsized":"2024-04-25T09:35:58.507308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"63'848","reported_seq":877,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.320994+0000","last_change":"2024-04-25T09:35:10.564722+0000","last_active":"2024-04-25T09:36:51.320994+0000","last_peered":"2024-04-25T09:36:51.320994+0000","last_clean":"2024-04-25T09:36:51.320994+0000","last_became_active":"2024-04-25T09:35:10.552184+0000","last_became_peered":"2024-04-25T09:35:10.552184+0000","last_unstale":"2024-04-25T09:36:51.320994+0000","last_undegraded":"2024-04-25T09:36:51.320994+0000","last_fullsized":"2024-04-25T09:36:51.320994+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.549658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:35:55.549658+0000","last_peered":"2024-04-25T09:35:55.549658+0000","last_clean":"2024-04-25T09:35:55.549658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:35:55.549658+0000","last_undegraded":"2024-04-25T09:35:55.549658+0000","last_fullsized":"2024-04-25T09:35:55.549658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"63'755","reported_seq":786,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.353048+0000","last_change":"2024-04-25T09:35:10.569015+0000","last_active":"2024-04-25T09:36:52.353048+0000","last_peered":"2024-04-25T09:36:52.353048+0000","last_clean":"2024-04-25T09:36:52.353048+0000","last_became_active":"2024-04-25T09:35:10.563969+0000","last_became_peered":"2024-04-25T09:35:10.563969+0000","last_unstale":"2024-04-25T09:36:52.353048+0000","last_undegraded":"2024-04-25T09:36:52.353048+0000","last_fullsized":"2024-04-25T09:36:52.353048+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.486270+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:35:58.486270+0000","last_peered":"2024-04-25T09:35:58.486270+0000","last_clean":"2024-04-25T09:35:58.486270+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:35:58.486270+0000","last_undegraded":"2024-04-25T09:35:58.486270+0000","last_fullsized":"2024-04-25T09:35:58.486270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"63'765","reported_seq":794,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.242798+0000","last_change":"2024-04-25T09:35:10.613091+0000","last_active":"2024-04-25T09:36:51.242798+0000","last_peered":"2024-04-25T09:36:51.242798+0000","last_clean":"2024-04-25T09:36:51.242798+0000","last_became_active":"2024-04-25T09:35:10.606399+0000","last_became_peered":"2024-04-25T09:35:10.606399+0000","last_unstale":"2024-04-25T09:36:51.242798+0000","last_undegraded":"2024-04-25T09:36:51.242798+0000","last_fullsized":"2024-04-25T09:36:51.242798+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:55.569089+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:35:55.569089+0000","last_peered":"2024-04-25T09:35:55.569089+0000","last_clean":"2024-04-25T09:35:55.569089+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:35:55.569089+0000","last_undegraded":"2024-04-25T09:35:55.569089+0000","last_fullsized":"2024-04-25T09:35:55.569089+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"63'623","reported_seq":656,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:51.319556+0000","last_change":"2024-04-25T09:35:10.628308+0000","last_active":"2024-04-25T09:36:51.319556+0000","last_peered":"2024-04-25T09:36:51.319556+0000","last_clean":"2024-04-25T09:36:51.319556+0000","last_became_active":"2024-04-25T09:35:10.612571+0000","last_became_peered":"2024-04-25T09:35:10.612571+0000","last_unstale":"2024-04-25T09:36:51.319556+0000","last_undegraded":"2024-04-25T09:36:51.319556+0000","last_fullsized":"2024-04-25T09:36:51.319556+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.498030+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:35:58.498030+0000","last_peered":"2024-04-25T09:35:58.498030+0000","last_clean":"2024-04-25T09:35:58.498030+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:35:58.498030+0000","last_undegraded":"2024-04-25T09:35:58.498030+0000","last_fullsized":"2024-04-25T09:35:58.498030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"63'689","reported_seq":720,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.193484+0000","last_change":"2024-04-25T09:35:10.581099+0000","last_active":"2024-04-25T09:36:52.193484+0000","last_peered":"2024-04-25T09:36:52.193484+0000","last_clean":"2024-04-25T09:36:52.193484+0000","last_became_active":"2024-04-25T09:35:10.576297+0000","last_became_peered":"2024-04-25T09:35:10.576297+0000","last_unstale":"2024-04-25T09:36:52.193484+0000","last_undegraded":"2024-04-25T09:36:52.193484+0000","last_fullsized":"2024-04-25T09:36:52.193484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":690,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.542442+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:35:58.542442+0000","last_peered":"2024-04-25T09:35:58.542442+0000","last_clean":"2024-04-25T09:35:58.542442+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:35:58.542442+0000","last_undegraded":"2024-04-25T09:35:58.542442+0000","last_fullsized":"2024-04-25T09:35:58.542442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"63'894","reported_seq":927,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.267366+0000","last_change":"2024-04-25T09:35:10.685786+0000","last_active":"2024-04-25T09:36:52.267366+0000","last_peered":"2024-04-25T09:36:52.267366+0000","last_clean":"2024-04-25T09:36:52.267366+0000","last_became_active":"2024-04-25T09:35:10.681315+0000","last_became_peered":"2024-04-25T09:35:10.681315+0000","last_unstale":"2024-04-25T09:36:52.267366+0000","last_undegraded":"2024-04-25T09:36:52.267366+0000","last_fullsized":"2024-04-25T09:36:52.267366+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":895,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.500139+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:35:58.500139+0000","last_peered":"2024-04-25T09:35:58.500139+0000","last_clean":"2024-04-25T09:35:58.500139+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:35:58.500139+0000","last_undegraded":"2024-04-25T09:35:58.500139+0000","last_fullsized":"2024-04-25T09:35:58.500139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"63'848","reported_seq":881,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:36:52.312223+0000","last_change":"2024-04-25T09:35:10.574577+0000","last_active":"2024-04-25T09:36:52.312223+0000","last_peered":"2024-04-25T09:36:52.312223+0000","last_clean":"2024-04-25T09:36:52.312223+0000","last_became_active":"2024-04-25T09:35:10.564874+0000","last_became_peered":"2024-04-25T09:35:10.564874+0000","last_unstale":"2024-04-25T09:36:52.312223+0000","last_undegraded":"2024-04-25T09:36:52.312223+0000","last_fullsized":"2024-04-25T09:36:52.312223+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:35:09.375102+0000","last_clean_scrub_stamp":"2024-04-25T09:35:09.375102+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-25T09:35:58.499218+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:35:58.499218+0000","last_peered":"2024-04-25T09:35:58.499218+0000","last_clean":"2024-04-25T09:35:58.499218+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:35:58.499218+0000","last_undegraded":"2024-04-25T09:35:58.499218+0000","last_fullsized":"2024-04-25T09:35:58.499218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":10780696,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12945,"num_write_kb":93217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18247680,"data_stored":36470856,"data_compressed":1883193,"data_compressed_allocated":18235392,"data_compressed_original":36470784,"omap_allocated":0,"internal_metadata":0},"log_size":12929,"ondisk_log_size":12929,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102788,"kb_used_data":5148,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94269052,"statfs":{"total":96636764160,"available":96531509248,"internally_reserved":0,"allocated":5271552,"data_stored":10122815,"data_compressed":512186,"data_compressed_allocated":4710400,"data_compressed_original":9912320,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88724,"kb_used_data":3596,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94283116,"statfs":{"total":96636764160,"available":96545910784,"internally_reserved":0,"allocated":3682304,"data_stored":6944319,"data_compressed":348063,"data_compressed_allocated":3121152,"data_compressed_original":6733824,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93096,"kb_used_data":7968,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94278744,"statfs":{"total":96636764160,"available":96541433856,"internally_reserved":0,"allocated":8159232,"data_stored":15430687,"data_compressed":786779,"data_compressed_allocated":7618560,"data_compressed_original":15237120,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88352,"kb_used_data":7352,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94283488,"statfs":{"total":96636764160,"available":96546291712,"internally_reserved":0,"allocated":7528448,"data_stored":14644775,"data_compressed":745682,"data_compressed_allocated":6971392,"data_compressed_original":14434304,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5914624,"data_stored":11829248,"data_compressed":610811,"data_compressed_allocated":5914624,"data_compressed_original":11829248,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6475776,"data_stored":12943384,"data_compressed":668339,"data_compressed_allocated":6471680,"data_compressed_original":12943360,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2297856,"data_stored":4587544,"data_compressed":236880,"data_compressed_allocated":2293760,"data_compressed_original":4587520,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3559424,"data_stored":7110680,"data_compressed":367163,"data_compressed_allocated":3555328,"data_compressed_original":7110656,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:36:56.372 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_4' removed 2024-04-25T09:36:56.391 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:36:56.392 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:36:56.392 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_5 2024-04-25T09:36:56.393 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_5 16 2024-04-25T09:36:56.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:56.518+0000 7f9b44510640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:56.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:56.531+0000 7f9b44510640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:57.301 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:36:57.383 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_5' created 2024-04-25T09:36:57.409 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2024-04-25T09:36:57.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:57.436+0000 7fb52759d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:57.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:57.443+0000 7fb52759d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:57.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:57.565+0000 7f1fe5b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:57.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:57.592+0000 7f1fe5b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:58.387 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_5' 2024-04-25T09:36:59.406 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_5 bench 90 write' 2024-04-25T09:36:59.409 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:36:59.410 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:36:59.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:36:59.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:36:59.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_52127 2024-04-25T09:36:59.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:36:59.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:36:59.694 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:36:59.818 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:59.828+0000 7f6ff026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:36:59.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:36:59.837+0000 7f6ff026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:00.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 137 121 0.945232 0.945312 0.146468 0.123197 2024-04-25T09:37:01.328 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:01.328 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:01.328 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:37:01.454 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:01.462+0000 7fb2d7c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:01.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:01.471+0000 7fb2d7c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:01.472 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 275 259 1.01163 1.07812 0.0755674 0.1184 2024-04-25T09:37:01.682 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:37:01.682 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:37:01.698 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-04-25T09:37:01.344361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":338752,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":336320,"kb_avail":377148608,"statfs":{"total":386547056640,"available":386200174592,"internally_reserved":0,"allocated":2457600,"data_stored":2593939,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":344391680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.957211"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T09:36:57.443249+0000","last_change":"2024-04-25T09:36:57.443249+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.443249+0000","last_undegraded":"2024-04-25T09:36:57.443249+0000","last_fullsized":"2024-04-25T09:36:57.443249+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":289,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:36:57.417183+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:36:57.417183+0000","last_peered":"2024-04-25T09:36:57.417183+0000","last_clean":"2024-04-25T09:36:57.417183+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:36:57.417183+0000","last_undegraded":"2024-04-25T09:36:57.417183+0000","last_fullsized":"2024-04-25T09:36:57.417183+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":145,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-25T09:36:56.455425+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:36:56.455425+0000","last_peered":"2024-04-25T09:36:56.455425+0000","last_clean":"2024-04-25T09:36:56.455425+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:36:56.455425+0000","last_undegraded":"2024-04-25T09:36:56.455425+0000","last_fullsized":"2024-04-25T09:36:56.455425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T09:36:57.456428+0000","last_change":"2024-04-25T09:36:57.456428+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.456428+0000","last_undegraded":"2024-04-25T09:36:57.456428+0000","last_fullsized":"2024-04-25T09:36:57.456428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:36:55.419727+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:36:55.419727+0000","last_peered":"2024-04-25T09:36:55.419727+0000","last_clean":"2024-04-25T09:36:55.419727+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:36:55.419727+0000","last_undegraded":"2024-04-25T09:36:55.419727+0000","last_fullsized":"2024-04-25T09:36:55.419727+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-25T09:36:56.453627+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:36:56.453627+0000","last_peered":"2024-04-25T09:36:56.453627+0000","last_clean":"2024-04-25T09:36:56.453627+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:36:56.453627+0000","last_undegraded":"2024-04-25T09:36:56.453627+0000","last_fullsized":"2024-04-25T09:36:56.453627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:36:55.424142+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:36:55.424142+0000","last_peered":"2024-04-25T09:36:55.424142+0000","last_clean":"2024-04-25T09:36:55.424142+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:36:55.424142+0000","last_undegraded":"2024-04-25T09:36:55.424142+0000","last_fullsized":"2024-04-25T09:36:55.424142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:36:57.472231+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:36:57.472231+0000","last_peered":"2024-04-25T09:36:57.472231+0000","last_clean":"2024-04-25T09:36:57.472231+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:36:57.472231+0000","last_undegraded":"2024-04-25T09:36:57.472231+0000","last_fullsized":"2024-04-25T09:36:57.472231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-04-25T09:36:57.471457+0000","last_change":"2024-04-25T09:36:57.471457+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.471457+0000","last_undegraded":"2024-04-25T09:36:57.471457+0000","last_fullsized":"2024-04-25T09:36:57.471457+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:36:57.433664+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:36:57.433664+0000","last_peered":"2024-04-25T09:36:57.433664+0000","last_clean":"2024-04-25T09:36:57.433664+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:36:57.433664+0000","last_undegraded":"2024-04-25T09:36:57.433664+0000","last_fullsized":"2024-04-25T09:36:57.433664+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:36:57.503724+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:36:57.503724+0000","last_peered":"2024-04-25T09:36:57.503724+0000","last_clean":"2024-04-25T09:36:57.503724+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:36:57.503724+0000","last_undegraded":"2024-04-25T09:36:57.503724+0000","last_fullsized":"2024-04-25T09:36:57.503724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:36:57.390740+0000","last_change":"2024-04-25T09:36:57.390740+0000","last_active":"2024-04-25T09:36:57.390740+0000","last_peered":"2024-04-25T09:36:57.390740+0000","last_clean":"2024-04-25T09:36:57.390740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:36:57.390740+0000","last_undegraded":"2024-04-25T09:36:57.390740+0000","last_fullsized":"2024-04-25T09:36:57.390740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-25T09:36:56.448142+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:36:56.448142+0000","last_peered":"2024-04-25T09:36:56.448142+0000","last_clean":"2024-04-25T09:36:56.448142+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:36:56.448142+0000","last_undegraded":"2024-04-25T09:36:56.448142+0000","last_fullsized":"2024-04-25T09:36:56.448142+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":9,"acting":9,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81596,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290244,"statfs":{"total":96636764160,"available":96553209856,"internally_reserved":0,"allocated":643072,"data_stored":800124,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85736,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94286104,"statfs":{"total":96636764160,"available":96548970496,"internally_reserved":0,"allocated":622592,"data_stored":793646,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706218,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85676,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94286164,"statfs":{"total":96636764160,"available":96549031936,"internally_reserved":0,"allocated":561152,"data_stored":203278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706218,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85744,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94286096,"statfs":{"total":96636764160,"available":96548962304,"internally_reserved":0,"allocated":630784,"data_stored":796891,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:37:02.111 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:02.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:02.266+0000 7f896a2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:02.260 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:02.273+0000 7f896a2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:02.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 412 396 1.03116 1.07031 0.158352 0.118332 2024-04-25T09:37:03.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 550 534 1.04287 1.07812 0.103575 0.118145 2024-04-25T09:37:04.454 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:04.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 684 668 1.04365 1.04688 0.0430145 0.118219 2024-04-25T09:37:04.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:04.603+0000 7fbe142ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:04.597 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:04.611+0000 7fbe142ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:05.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 809 793 1.03246 0.976562 0.168006 0.119619 2024-04-25T09:37:06.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 955 939 1.0479 1.14062 0.135237 0.11827 2024-04-25T09:37:06.700 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:06.700 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:06.700 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:37:06.700 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:37:06.789 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:06.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:06.845+0000 7f39244ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:06.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:06.861+0000 7f39244ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:06.873 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:06.873 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:06.873 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:06.874 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:06.878 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:06.879 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:06.879 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:37:06.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:06.939+0000 7f079e55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:06.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:06.949+0000 7f079e55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:07.020 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:07.024+0000 7fcc2ca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:07.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:07.038+0000 7fcc2ca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:07.099 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:07.099 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:07.099 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:07.099 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:07.099 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:07.099 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:07.099 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:07.100 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:07.100 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:07.100 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:07.100 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:07.100 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:07.103 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:07.103 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:07.103 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:37:07.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:07.248+0000 7f19cc824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:07.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:07.262+0000 7f19cc824640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:07.273 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:07.273 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:07.274 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:07.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:07.278 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:07.278 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:37:07.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:07.462+0000 7f1b46aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:07.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:07.473+0000 7f1b46aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:07.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1083 1067 1.0419 1 0.0604737 0.11888 2024-04-25T09:37:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:07.536 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:07.537 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:07.540 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:07.540 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:08.473 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1226 1210 1.05025 1.11719 0.267819 0.118092 2024-04-25T09:37:09.217 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:09.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:09.361+0000 7f6d6be20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:09.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:09.368+0000 7f6d6be20640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:09.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 1372 1356 1.05928 1.14062 0.107267 0.117284 2024-04-25T09:37:10.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1503 1487 1.05601 1.02344 0.245953 0.117669 2024-04-25T09:37:11.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1650 1634 1.0637 1.14844 0.125263 0.11698 2024-04-25T09:37:11.632 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:11.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:11.763+0000 7ff93d86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:11.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:11.771+0000 7ff93d86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:12.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 1780 1764 1.06 1.01562 0.118279 0.1174 2024-04-25T09:37:12.541 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:12.542 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:12.542 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:37:12.542 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:37:12.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:12.683+0000 7f7ded2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:12.682 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:12.694+0000 7f7ded2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:12.725 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:12.728 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:12.728 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:12.729 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:37:12.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:12.870+0000 7f7abfc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:12.869 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:12.882+0000 7f7abfc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:12.895 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:12.896 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:12.896 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:12.896 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:12.899 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:12.899 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:12.900 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:37:13.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:13.038+0000 7fdea539d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:13.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:13.051+0000 7fdea539d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:13.056 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:13.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:13.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:13.057 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:13.057 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:13.059 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:13.059 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:13.060 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:37:13.190 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:13.195+0000 7f5442464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:13.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:13.207+0000 7f5442464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:13.219 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:13.222 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:13.223 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:13.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 1913 1897 1.0585 1.03906 0.132542 0.117623 2024-04-25T09:37:13.992 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:14.122 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:14.132+0000 7f2509d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:14.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:14.139+0000 7f2509d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:14.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2041 2025 1.05459 1 0.181776 0.117969 2024-04-25T09:37:15.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2184 2168 1.0585 1.11719 0.0995326 0.117603 2024-04-25T09:37:16.290 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:16.417 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:16.426+0000 7fb7c146d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:16.422 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:16.433+0000 7fb7c146d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:16.474 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2309 2293 1.05367 0.976562 0.148028 0.117967 2024-04-25T09:37:17.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2440 2424 1.05199 1.02344 0.0397987 0.118119 2024-04-25T09:37:18.224 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:18.224 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:37:18.360 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:18.364+0000 7f516646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:18.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:18.377+0000 7f516646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:18.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 2590 2574 1.05829 1.17188 0.141511 0.117649 2024-04-25T09:37:18.608 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:18.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:18.746+0000 7f979962d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:18.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:18.753+0000 7f979962d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:19.372 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:37:19.392 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:37:19.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:37:19.488502+0000 min lat: 0.0155076 max lat: 0.316757 avg lat: 0.117467 2024-04-25T09:37:19.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:37:19.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 2728 2712 1.05928 1.07812 0.108561 0.117467 2024-04-25T09:37:19.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:19.538+0000 7f4924e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:19.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:19.551+0000 7f4924e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:20.373 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:37:20.390 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:37:20.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 2853 2837 1.05533 0.976562 0.194419 0.117898 2024-04-25T09:37:20.524 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:20.529+0000 7fcf2026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:20.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:20.540+0000 7fcf2026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:21.003 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:21.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:21.152+0000 7fb0cb2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:21.147 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:21.159+0000 7fb0cb2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:21.389 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:37:21.406 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:37:21.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 2971 2955 1.04926 0.921875 0.169601 0.11869 2024-04-25T09:37:21.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:21.605+0000 7f1f46b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:21.607 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:21.619+0000 7f1f458fb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:22.390 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:37:22.407 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:37:22.408 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:37:22.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3117 3101 1.05323 1.14062 0.142766 0.118224 2024-04-25T09:37:22.594 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:22.600+0000 7f4c4e71d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:22.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:22.610+0000 7f4c4e71d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:22.840 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:37:22.841 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:37:22.858 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-04-25T09:37:22.406037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23421472,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2924,"num_write_kb":24190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2868,"ondisk_log_size":2868,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":387648,"kb_used_data":34656,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":377099712,"statfs":{"total":386547056640,"available":386150105088,"internally_reserved":0,"allocated":35487744,"data_stored":68318355,"data_compressed":3476070,"data_compressed_allocated":32944128,"data_compressed_original":67362816,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5111808,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.057967"},"pg_stats":[{"pgid":"8.7","version":"72'135","reported_seq":151,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:16.803170+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:37:16.803170+0000","last_peered":"2024-04-25T09:37:16.803170+0000","last_clean":"2024-04-25T09:37:16.803170+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:37:16.803170+0000","last_undegraded":"2024-04-25T09:37:16.803170+0000","last_fullsized":"2024-04-25T09:37:16.803170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"72'135","reported_seq":151,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:15.862218+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:37:15.862218+0000","last_peered":"2024-04-25T09:37:15.862218+0000","last_clean":"2024-04-25T09:37:15.862218+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:37:15.862218+0000","last_undegraded":"2024-04-25T09:37:15.862218+0000","last_fullsized":"2024-04-25T09:37:15.862218+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"74'151","reported_seq":171,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.913836+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:37:20.913836+0000","last_peered":"2024-04-25T09:37:20.913836+0000","last_clean":"2024-04-25T09:37:20.913836+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:37:20.913836+0000","last_undegraded":"2024-04-25T09:37:20.913836+0000","last_fullsized":"2024-04-25T09:37:20.913836+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"73'231","reported_seq":250,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.563931+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:37:19.563931+0000","last_peered":"2024-04-25T09:37:19.563931+0000","last_clean":"2024-04-25T09:37:19.563931+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:37:19.563931+0000","last_undegraded":"2024-04-25T09:37:19.563931+0000","last_fullsized":"2024-04-25T09:37:19.563931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"74'191","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.829156+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:37:20.829156+0000","last_peered":"2024-04-25T09:37:20.829156+0000","last_clean":"2024-04-25T09:37:20.829156+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:37:20.829156+0000","last_undegraded":"2024-04-25T09:37:20.829156+0000","last_fullsized":"2024-04-25T09:37:20.829156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"73'103","reported_seq":122,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.998845+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:37:19.998845+0000","last_peered":"2024-04-25T09:37:19.998845+0000","last_clean":"2024-04-25T09:37:19.998845+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:37:19.998845+0000","last_undegraded":"2024-04-25T09:37:19.998845+0000","last_fullsized":"2024-04-25T09:37:19.998845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"72'199","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:16.300882+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:37:16.300882+0000","last_peered":"2024-04-25T09:37:16.300882+0000","last_clean":"2024-04-25T09:37:16.300882+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:37:16.300882+0000","last_undegraded":"2024-04-25T09:37:16.300882+0000","last_fullsized":"2024-04-25T09:37:16.300882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"74'230","reported_seq":250,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.449552+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:37:21.449552+0000","last_peered":"2024-04-25T09:37:21.449552+0000","last_clean":"2024-04-25T09:37:21.449552+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:37:21.449552+0000","last_undegraded":"2024-04-25T09:37:21.449552+0000","last_fullsized":"2024-04-25T09:37:21.449552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1892352,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"73'183","reported_seq":202,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.462152+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:37:20.462152+0000","last_peered":"2024-04-25T09:37:20.462152+0000","last_clean":"2024-04-25T09:37:20.462152+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:37:20.462152+0000","last_undegraded":"2024-04-25T09:37:20.462152+0000","last_fullsized":"2024-04-25T09:37:20.462152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":298,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.392843+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:04.392843+0000","last_peered":"2024-04-25T09:37:04.392843+0000","last_clean":"2024-04-25T09:37:04.392843+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:04.392843+0000","last_undegraded":"2024-04-25T09:37:04.392843+0000","last_fullsized":"2024-04-25T09:37:04.392843+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.472754+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:20.472754+0000","last_peered":"2024-04-25T09:37:20.472754+0000","last_clean":"2024-04-25T09:37:20.472754+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:20.472754+0000","last_undegraded":"2024-04-25T09:37:20.472754+0000","last_fullsized":"2024-04-25T09:37:20.472754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"72'219","reported_seq":235,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:17.457287+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:37:17.457287+0000","last_peered":"2024-04-25T09:37:17.457287+0000","last_clean":"2024-04-25T09:37:17.457287+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:37:17.457287+0000","last_undegraded":"2024-04-25T09:37:17.457287+0000","last_fullsized":"2024-04-25T09:37:17.457287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802240,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":1760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.474627+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:19.474627+0000","last_peered":"2024-04-25T09:37:19.474627+0000","last_clean":"2024-04-25T09:37:19.474627+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:19.474627+0000","last_undegraded":"2024-04-25T09:37:19.474627+0000","last_fullsized":"2024-04-25T09:37:19.474627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"73'127","reported_seq":146,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.127361+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:37:21.127361+0000","last_peered":"2024-04-25T09:37:21.127361+0000","last_clean":"2024-04-25T09:37:21.127361+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:37:21.127361+0000","last_undegraded":"2024-04-25T09:37:21.127361+0000","last_fullsized":"2024-04-25T09:37:21.127361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.470093+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:20.470093+0000","last_peered":"2024-04-25T09:37:20.470093+0000","last_clean":"2024-04-25T09:37:20.470093+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:20.470093+0000","last_undegraded":"2024-04-25T09:37:20.470093+0000","last_fullsized":"2024-04-25T09:37:20.470093+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"74'191","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.570938+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:37:20.570938+0000","last_peered":"2024-04-25T09:37:20.570938+0000","last_clean":"2024-04-25T09:37:20.570938+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:37:20.570938+0000","last_undegraded":"2024-04-25T09:37:20.570938+0000","last_fullsized":"2024-04-25T09:37:20.570938+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.470548+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:19.470548+0000","last_peered":"2024-04-25T09:37:19.470548+0000","last_clean":"2024-04-25T09:37:19.470548+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:19.470548+0000","last_undegraded":"2024-04-25T09:37:19.470548+0000","last_fullsized":"2024-04-25T09:37:19.470548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"73'190","reported_seq":209,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.469513+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:37:21.469513+0000","last_peered":"2024-04-25T09:37:21.469513+0000","last_clean":"2024-04-25T09:37:21.469513+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:37:21.469513+0000","last_undegraded":"2024-04-25T09:37:21.469513+0000","last_fullsized":"2024-04-25T09:37:21.469513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564672,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":1528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.585610+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:04.585610+0000","last_peered":"2024-04-25T09:37:04.585610+0000","last_clean":"2024-04-25T09:37:04.585610+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:04.585610+0000","last_undegraded":"2024-04-25T09:37:04.585610+0000","last_fullsized":"2024-04-25T09:37:04.585610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"72'159","reported_seq":175,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:17.276583+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:37:17.276583+0000","last_peered":"2024-04-25T09:37:17.276583+0000","last_clean":"2024-04-25T09:37:17.276583+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:37:17.276583+0000","last_undegraded":"2024-04-25T09:37:17.276583+0000","last_fullsized":"2024-04-25T09:37:17.276583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.395929+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:04.395929+0000","last_peered":"2024-04-25T09:37:04.395929+0000","last_clean":"2024-04-25T09:37:04.395929+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:04.395929+0000","last_undegraded":"2024-04-25T09:37:04.395929+0000","last_fullsized":"2024-04-25T09:37:04.395929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'167","reported_seq":186,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.007848+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:37:21.007848+0000","last_peered":"2024-04-25T09:37:21.007848+0000","last_clean":"2024-04-25T09:37:21.007848+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:37:21.007848+0000","last_undegraded":"2024-04-25T09:37:21.007848+0000","last_fullsized":"2024-04-25T09:37:21.007848+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.577499+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:04.577499+0000","last_peered":"2024-04-25T09:37:04.577499+0000","last_clean":"2024-04-25T09:37:04.577499+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:04.577499+0000","last_undegraded":"2024-04-25T09:37:04.577499+0000","last_fullsized":"2024-04-25T09:37:04.577499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"73'160","reported_seq":179,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.262360+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:37:20.262360+0000","last_peered":"2024-04-25T09:37:20.262360+0000","last_clean":"2024-04-25T09:37:20.262360+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:37:20.262360+0000","last_undegraded":"2024-04-25T09:37:20.262360+0000","last_fullsized":"2024-04-25T09:37:20.262360+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318912,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.470386+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:20.470386+0000","last_peered":"2024-04-25T09:37:20.470386+0000","last_clean":"2024-04-25T09:37:20.470386+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:20.470386+0000","last_undegraded":"2024-04-25T09:37:20.470386+0000","last_fullsized":"2024-04-25T09:37:20.470386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":22831104,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2787,"num_write_kb":22296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33398784,"data_stored":66797568,"data_compressed":3445812,"data_compressed_allocated":33398784,"data_compressed_original":66797568,"omap_allocated":0,"internal_metadata":0},"log_size":2771,"ondisk_log_size":2771,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97656,"kb_used_data":8368,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94274184,"statfs":{"total":96636764160,"available":96536764416,"internally_reserved":0,"allocated":8568832,"data_stored":16600107,"data_compressed":844150,"data_compressed_allocated":7933952,"data_compressed_original":16359424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94528,"kb_used_data":5240,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94277312,"statfs":{"total":96636764160,"available":96539967488,"internally_reserved":0,"allocated":5365760,"data_stored":10193963,"data_compressed":513786,"data_compressed_allocated":4730880,"data_compressed_original":9953280,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92108,"kb_used_data":11140,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94279732,"statfs":{"total":96636764160,"available":96542445568,"internally_reserved":0,"allocated":11407360,"data_stored":21783397,"data_compressed":1111859,"data_compressed_allocated":10776576,"data_compressed_original":21553152,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103356,"kb_used_data":9908,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94268484,"statfs":{"total":96636764160,"available":96530927616,"internally_reserved":0,"allocated":10145792,"data_stored":19740888,"data_compressed":1006275,"data_compressed_allocated":9502720,"data_compressed_original":19496960,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9568256,"data_stored":19136512,"data_compressed":987306,"data_compressed_allocated":9568256,"data_compressed_original":19136512,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10940416,"data_stored":21880832,"data_compressed":1128779,"data_compressed_allocated":10940416,"data_compressed_original":21880832,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":9773056,"data_compressed":504123,"data_compressed_allocated":4886528,"data_compressed_original":9773056,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8003584,"data_stored":16007168,"data_compressed":825604,"data_compressed_allocated":8003584,"data_compressed_original":16007168,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:37:22.859 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:37:23.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:23.046+0000 7f2debf9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:23.043 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:23.055+0000 7f2debf9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:23.264 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:37:23.264 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:37:23.280 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-04-25T09:37:22.406037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23421472,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2924,"num_write_kb":24190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2868,"ondisk_log_size":2868,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":387648,"kb_used_data":34656,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":377099712,"statfs":{"total":386547056640,"available":386150105088,"internally_reserved":0,"allocated":35487744,"data_stored":68318355,"data_compressed":3476070,"data_compressed_allocated":32944128,"data_compressed_original":67362816,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5111808,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.057967"},"pg_stats":[{"pgid":"8.7","version":"72'135","reported_seq":151,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:16.803170+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:37:16.803170+0000","last_peered":"2024-04-25T09:37:16.803170+0000","last_clean":"2024-04-25T09:37:16.803170+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:37:16.803170+0000","last_undegraded":"2024-04-25T09:37:16.803170+0000","last_fullsized":"2024-04-25T09:37:16.803170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"72'135","reported_seq":151,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:15.862218+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:37:15.862218+0000","last_peered":"2024-04-25T09:37:15.862218+0000","last_clean":"2024-04-25T09:37:15.862218+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:37:15.862218+0000","last_undegraded":"2024-04-25T09:37:15.862218+0000","last_fullsized":"2024-04-25T09:37:15.862218+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"74'151","reported_seq":171,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.913836+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:37:20.913836+0000","last_peered":"2024-04-25T09:37:20.913836+0000","last_clean":"2024-04-25T09:37:20.913836+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:37:20.913836+0000","last_undegraded":"2024-04-25T09:37:20.913836+0000","last_fullsized":"2024-04-25T09:37:20.913836+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"73'231","reported_seq":250,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.563931+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:37:19.563931+0000","last_peered":"2024-04-25T09:37:19.563931+0000","last_clean":"2024-04-25T09:37:19.563931+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:37:19.563931+0000","last_undegraded":"2024-04-25T09:37:19.563931+0000","last_fullsized":"2024-04-25T09:37:19.563931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"74'191","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.829156+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:37:20.829156+0000","last_peered":"2024-04-25T09:37:20.829156+0000","last_clean":"2024-04-25T09:37:20.829156+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:37:20.829156+0000","last_undegraded":"2024-04-25T09:37:20.829156+0000","last_fullsized":"2024-04-25T09:37:20.829156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"73'103","reported_seq":122,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.998845+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:37:19.998845+0000","last_peered":"2024-04-25T09:37:19.998845+0000","last_clean":"2024-04-25T09:37:19.998845+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:37:19.998845+0000","last_undegraded":"2024-04-25T09:37:19.998845+0000","last_fullsized":"2024-04-25T09:37:19.998845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"72'199","reported_seq":215,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:16.300882+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:37:16.300882+0000","last_peered":"2024-04-25T09:37:16.300882+0000","last_clean":"2024-04-25T09:37:16.300882+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:37:16.300882+0000","last_undegraded":"2024-04-25T09:37:16.300882+0000","last_fullsized":"2024-04-25T09:37:16.300882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"74'230","reported_seq":250,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.449552+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:37:21.449552+0000","last_peered":"2024-04-25T09:37:21.449552+0000","last_clean":"2024-04-25T09:37:21.449552+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:37:21.449552+0000","last_undegraded":"2024-04-25T09:37:21.449552+0000","last_fullsized":"2024-04-25T09:37:21.449552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1892352,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"73'183","reported_seq":202,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.462152+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:37:20.462152+0000","last_peered":"2024-04-25T09:37:20.462152+0000","last_clean":"2024-04-25T09:37:20.462152+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:37:20.462152+0000","last_undegraded":"2024-04-25T09:37:20.462152+0000","last_fullsized":"2024-04-25T09:37:20.462152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":298,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.392843+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:04.392843+0000","last_peered":"2024-04-25T09:37:04.392843+0000","last_clean":"2024-04-25T09:37:04.392843+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:04.392843+0000","last_undegraded":"2024-04-25T09:37:04.392843+0000","last_fullsized":"2024-04-25T09:37:04.392843+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.472754+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:20.472754+0000","last_peered":"2024-04-25T09:37:20.472754+0000","last_clean":"2024-04-25T09:37:20.472754+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:20.472754+0000","last_undegraded":"2024-04-25T09:37:20.472754+0000","last_fullsized":"2024-04-25T09:37:20.472754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"72'219","reported_seq":235,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:17.457287+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:37:17.457287+0000","last_peered":"2024-04-25T09:37:17.457287+0000","last_clean":"2024-04-25T09:37:17.457287+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:37:17.457287+0000","last_undegraded":"2024-04-25T09:37:17.457287+0000","last_fullsized":"2024-04-25T09:37:17.457287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1802240,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":1760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.474627+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:19.474627+0000","last_peered":"2024-04-25T09:37:19.474627+0000","last_clean":"2024-04-25T09:37:19.474627+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:19.474627+0000","last_undegraded":"2024-04-25T09:37:19.474627+0000","last_fullsized":"2024-04-25T09:37:19.474627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"73'127","reported_seq":146,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.127361+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:37:21.127361+0000","last_peered":"2024-04-25T09:37:21.127361+0000","last_clean":"2024-04-25T09:37:21.127361+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:37:21.127361+0000","last_undegraded":"2024-04-25T09:37:21.127361+0000","last_fullsized":"2024-04-25T09:37:21.127361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.470093+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:20.470093+0000","last_peered":"2024-04-25T09:37:20.470093+0000","last_clean":"2024-04-25T09:37:20.470093+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:20.470093+0000","last_undegraded":"2024-04-25T09:37:20.470093+0000","last_fullsized":"2024-04-25T09:37:20.470093+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"74'191","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.570938+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:37:20.570938+0000","last_peered":"2024-04-25T09:37:20.570938+0000","last_clean":"2024-04-25T09:37:20.570938+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:37:20.570938+0000","last_undegraded":"2024-04-25T09:37:20.570938+0000","last_fullsized":"2024-04-25T09:37:20.570938+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.470548+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:19.470548+0000","last_peered":"2024-04-25T09:37:19.470548+0000","last_clean":"2024-04-25T09:37:19.470548+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:19.470548+0000","last_undegraded":"2024-04-25T09:37:19.470548+0000","last_fullsized":"2024-04-25T09:37:19.470548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"73'190","reported_seq":209,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.469513+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:37:21.469513+0000","last_peered":"2024-04-25T09:37:21.469513+0000","last_clean":"2024-04-25T09:37:21.469513+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:37:21.469513+0000","last_undegraded":"2024-04-25T09:37:21.469513+0000","last_fullsized":"2024-04-25T09:37:21.469513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564672,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":1528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.585610+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:04.585610+0000","last_peered":"2024-04-25T09:37:04.585610+0000","last_clean":"2024-04-25T09:37:04.585610+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:04.585610+0000","last_undegraded":"2024-04-25T09:37:04.585610+0000","last_fullsized":"2024-04-25T09:37:04.585610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"72'159","reported_seq":175,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:17.276583+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:37:17.276583+0000","last_peered":"2024-04-25T09:37:17.276583+0000","last_clean":"2024-04-25T09:37:17.276583+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:37:17.276583+0000","last_undegraded":"2024-04-25T09:37:17.276583+0000","last_fullsized":"2024-04-25T09:37:17.276583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.395929+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:04.395929+0000","last_peered":"2024-04-25T09:37:04.395929+0000","last_clean":"2024-04-25T09:37:04.395929+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:04.395929+0000","last_undegraded":"2024-04-25T09:37:04.395929+0000","last_fullsized":"2024-04-25T09:37:04.395929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'167","reported_seq":186,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.007848+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:37:21.007848+0000","last_peered":"2024-04-25T09:37:21.007848+0000","last_clean":"2024-04-25T09:37:21.007848+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:37:21.007848+0000","last_undegraded":"2024-04-25T09:37:21.007848+0000","last_fullsized":"2024-04-25T09:37:21.007848+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":161,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-25T09:37:04.577499+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:04.577499+0000","last_peered":"2024-04-25T09:37:04.577499+0000","last_clean":"2024-04-25T09:37:04.577499+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:04.577499+0000","last_undegraded":"2024-04-25T09:37:04.577499+0000","last_fullsized":"2024-04-25T09:37:04.577499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"73'160","reported_seq":179,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.262360+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:37:20.262360+0000","last_peered":"2024-04-25T09:37:20.262360+0000","last_clean":"2024-04-25T09:37:20.262360+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:37:20.262360+0000","last_undegraded":"2024-04-25T09:37:20.262360+0000","last_fullsized":"2024-04-25T09:37:20.262360+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318912,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.470386+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:20.470386+0000","last_peered":"2024-04-25T09:37:20.470386+0000","last_clean":"2024-04-25T09:37:20.470386+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:20.470386+0000","last_undegraded":"2024-04-25T09:37:20.470386+0000","last_fullsized":"2024-04-25T09:37:20.470386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":22831104,"num_objects":350,"num_object_clones":0,"num_object_copies":1050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2787,"num_write_kb":22296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33398784,"data_stored":66797568,"data_compressed":3445812,"data_compressed_allocated":33398784,"data_compressed_original":66797568,"omap_allocated":0,"internal_metadata":0},"log_size":2771,"ondisk_log_size":2771,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97656,"kb_used_data":8368,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94274184,"statfs":{"total":96636764160,"available":96536764416,"internally_reserved":0,"allocated":8568832,"data_stored":16600107,"data_compressed":844150,"data_compressed_allocated":7933952,"data_compressed_original":16359424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94528,"kb_used_data":5240,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94277312,"statfs":{"total":96636764160,"available":96539967488,"internally_reserved":0,"allocated":5365760,"data_stored":10193963,"data_compressed":513786,"data_compressed_allocated":4730880,"data_compressed_original":9953280,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92108,"kb_used_data":11140,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94279732,"statfs":{"total":96636764160,"available":96542445568,"internally_reserved":0,"allocated":11407360,"data_stored":21783397,"data_compressed":1111859,"data_compressed_allocated":10776576,"data_compressed_original":21553152,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103356,"kb_used_data":9908,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94268484,"statfs":{"total":96636764160,"available":96530927616,"internally_reserved":0,"allocated":10145792,"data_stored":19740888,"data_compressed":1006275,"data_compressed_allocated":9502720,"data_compressed_original":19496960,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9568256,"data_stored":19136512,"data_compressed":987306,"data_compressed_allocated":9568256,"data_compressed_original":19136512,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10940416,"data_stored":21880832,"data_compressed":1128779,"data_compressed_allocated":10940416,"data_compressed_original":21880832,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":9773056,"data_compressed":504123,"data_compressed_allocated":4886528,"data_compressed_original":9773056,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8003584,"data_stored":16007168,"data_compressed":825604,"data_compressed_allocated":8003584,"data_compressed_original":16007168,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:37:23.282 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:37:23.282 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:23.282 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:37:23.404 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:23.414 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:23.421+0000 7fdf7e2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:23.420 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:23.432+0000 7fdf7e2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:23.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3233 3217 1.0471 0.90625 0.136373 0.119037 2024-04-25T09:37:23.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:23.544+0000 7f65b899d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:23.540 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:23.553+0000 7f65b899d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:23.675 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:37:23.675 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:37:23.688 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-04-25T09:37:23.349313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25289248,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":3152,"num_write_kb":26014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3097,"ondisk_log_size":3097,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":395644,"kb_used_data":38492,"kb_used_omap":0,"kb_used_meta":357120,"kb_avail":377091716,"statfs":{"total":386547056640,"available":386141917184,"internally_reserved":0,"allocated":39415808,"data_stored":76108788,"data_compressed":3877497,"data_compressed_allocated":36831232,"data_compressed_original":75137024,"omap_allocated":0,"internal_metadata":365690880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5586944,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":5456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000832"},"pg_stats":[{"pgid":"8.7","version":"75'183","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.793549+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:37:21.793549+0000","last_peered":"2024-04-25T09:37:21.793549+0000","last_clean":"2024-04-25T09:37:21.793549+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:37:21.793549+0000","last_undegraded":"2024-04-25T09:37:21.793549+0000","last_fullsized":"2024-04-25T09:37:21.793549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"72'160","reported_seq":180,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.448338+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:37:21.448338+0000","last_peered":"2024-04-25T09:37:21.448338+0000","last_clean":"2024-04-25T09:37:21.448338+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:37:21.448338+0000","last_undegraded":"2024-04-25T09:37:21.448338+0000","last_fullsized":"2024-04-25T09:37:21.448338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"74'151","reported_seq":171,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.913836+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:37:20.913836+0000","last_peered":"2024-04-25T09:37:20.913836+0000","last_clean":"2024-04-25T09:37:20.913836+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:37:20.913836+0000","last_undegraded":"2024-04-25T09:37:20.913836+0000","last_fullsized":"2024-04-25T09:37:20.913836+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"73'231","reported_seq":250,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.563931+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:37:19.563931+0000","last_peered":"2024-04-25T09:37:19.563931+0000","last_clean":"2024-04-25T09:37:19.563931+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:37:19.563931+0000","last_undegraded":"2024-04-25T09:37:19.563931+0000","last_fullsized":"2024-04-25T09:37:19.563931+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"74'191","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.829156+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:37:20.829156+0000","last_peered":"2024-04-25T09:37:20.829156+0000","last_clean":"2024-04-25T09:37:20.829156+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:37:20.829156+0000","last_undegraded":"2024-04-25T09:37:20.829156+0000","last_fullsized":"2024-04-25T09:37:20.829156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"73'103","reported_seq":122,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.998845+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:37:19.998845+0000","last_peered":"2024-04-25T09:37:19.998845+0000","last_clean":"2024-04-25T09:37:19.998845+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:37:19.998845+0000","last_undegraded":"2024-04-25T09:37:19.998845+0000","last_fullsized":"2024-04-25T09:37:19.998845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"74'247","reported_seq":267,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.252620+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:37:22.252620+0000","last_peered":"2024-04-25T09:37:22.252620+0000","last_clean":"2024-04-25T09:37:22.252620+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:37:22.252620+0000","last_undegraded":"2024-04-25T09:37:22.252620+0000","last_fullsized":"2024-04-25T09:37:22.252620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"74'230","reported_seq":250,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.449552+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:37:21.449552+0000","last_peered":"2024-04-25T09:37:21.449552+0000","last_clean":"2024-04-25T09:37:21.449552+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:37:21.449552+0000","last_undegraded":"2024-04-25T09:37:21.449552+0000","last_fullsized":"2024-04-25T09:37:21.449552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1892352,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":231,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"73'183","reported_seq":202,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.462152+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:37:20.462152+0000","last_peered":"2024-04-25T09:37:20.462152+0000","last_clean":"2024-04-25T09:37:20.462152+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:37:20.462152+0000","last_undegraded":"2024-04-25T09:37:20.462152+0000","last_fullsized":"2024-04-25T09:37:20.462152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":302,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.622399+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:20.622399+0000","last_peered":"2024-04-25T09:37:20.622399+0000","last_clean":"2024-04-25T09:37:20.622399+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:20.622399+0000","last_undegraded":"2024-04-25T09:37:20.622399+0000","last_fullsized":"2024-04-25T09:37:20.622399+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.472754+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:20.472754+0000","last_peered":"2024-04-25T09:37:20.472754+0000","last_clean":"2024-04-25T09:37:20.472754+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:20.472754+0000","last_undegraded":"2024-04-25T09:37:20.472754+0000","last_fullsized":"2024-04-25T09:37:20.472754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"74'271","reported_seq":291,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.971501+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:37:21.971501+0000","last_peered":"2024-04-25T09:37:21.971501+0000","last_clean":"2024-04-25T09:37:21.971501+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:37:21.971501+0000","last_undegraded":"2024-04-25T09:37:21.971501+0000","last_fullsized":"2024-04-25T09:37:21.971501+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.474627+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:19.474627+0000","last_peered":"2024-04-25T09:37:19.474627+0000","last_clean":"2024-04-25T09:37:19.474627+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:19.474627+0000","last_undegraded":"2024-04-25T09:37:19.474627+0000","last_fullsized":"2024-04-25T09:37:19.474627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"73'127","reported_seq":146,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.127361+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:37:21.127361+0000","last_peered":"2024-04-25T09:37:21.127361+0000","last_clean":"2024-04-25T09:37:21.127361+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:37:21.127361+0000","last_undegraded":"2024-04-25T09:37:21.127361+0000","last_fullsized":"2024-04-25T09:37:21.127361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.470093+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:20.470093+0000","last_peered":"2024-04-25T09:37:20.470093+0000","last_clean":"2024-04-25T09:37:20.470093+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:20.470093+0000","last_undegraded":"2024-04-25T09:37:20.470093+0000","last_fullsized":"2024-04-25T09:37:20.470093+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"74'191","reported_seq":211,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.570938+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:37:20.570938+0000","last_peered":"2024-04-25T09:37:20.570938+0000","last_clean":"2024-04-25T09:37:20.570938+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:37:20.570938+0000","last_undegraded":"2024-04-25T09:37:20.570938+0000","last_fullsized":"2024-04-25T09:37:20.570938+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:19.470548+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:19.470548+0000","last_peered":"2024-04-25T09:37:19.470548+0000","last_clean":"2024-04-25T09:37:19.470548+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:19.470548+0000","last_undegraded":"2024-04-25T09:37:19.470548+0000","last_fullsized":"2024-04-25T09:37:19.470548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"73'190","reported_seq":209,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.469513+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:37:21.469513+0000","last_peered":"2024-04-25T09:37:21.469513+0000","last_clean":"2024-04-25T09:37:21.469513+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:37:21.469513+0000","last_undegraded":"2024-04-25T09:37:21.469513+0000","last_fullsized":"2024-04-25T09:37:21.469513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564672,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":1528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.465359+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:21.465359+0000","last_peered":"2024-04-25T09:37:21.465359+0000","last_clean":"2024-04-25T09:37:21.465359+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:21.465359+0000","last_undegraded":"2024-04-25T09:37:21.465359+0000","last_fullsized":"2024-04-25T09:37:21.465359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"74'215","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.361503+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:37:22.361503+0000","last_peered":"2024-04-25T09:37:22.361503+0000","last_clean":"2024-04-25T09:37:22.361503+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:37:22.361503+0000","last_undegraded":"2024-04-25T09:37:22.361503+0000","last_fullsized":"2024-04-25T09:37:22.361503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.629847+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:20.629847+0000","last_peered":"2024-04-25T09:37:20.629847+0000","last_clean":"2024-04-25T09:37:20.629847+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:20.629847+0000","last_undegraded":"2024-04-25T09:37:20.629847+0000","last_fullsized":"2024-04-25T09:37:20.629847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"73'167","reported_seq":186,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.007848+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:37:21.007848+0000","last_peered":"2024-04-25T09:37:21.007848+0000","last_clean":"2024-04-25T09:37:21.007848+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:37:21.007848+0000","last_undegraded":"2024-04-25T09:37:21.007848+0000","last_fullsized":"2024-04-25T09:37:21.007848+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.476056+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:21.476056+0000","last_peered":"2024-04-25T09:37:21.476056+0000","last_clean":"2024-04-25T09:37:21.476056+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:21.476056+0000","last_undegraded":"2024-04-25T09:37:21.476056+0000","last_fullsized":"2024-04-25T09:37:21.476056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"73'160","reported_seq":179,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.262360+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:37:20.262360+0000","last_peered":"2024-04-25T09:37:20.262360+0000","last_clean":"2024-04-25T09:37:20.262360+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:37:20.262360+0000","last_undegraded":"2024-04-25T09:37:20.262360+0000","last_fullsized":"2024-04-25T09:37:20.262360+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1318912,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":1288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.470386+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:20.470386+0000","last_peered":"2024-04-25T09:37:20.470386+0000","last_clean":"2024-04-25T09:37:20.470386+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:20.470386+0000","last_undegraded":"2024-04-25T09:37:20.470386+0000","last_fullsized":"2024-04-25T09:37:20.470386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":24698880,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3015,"num_write_kb":24120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37208064,"data_stored":74416128,"data_compressed":3839202,"data_compressed_allocated":37208064,"data_compressed_original":74416128,"omap_allocated":0,"internal_metadata":0},"log_size":3000,"ondisk_log_size":3000,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99684,"kb_used_data":10396,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94272156,"statfs":{"total":96636764160,"available":96534687744,"internally_reserved":0,"allocated":10645504,"data_stored":20727173,"data_compressed":1056919,"data_compressed_allocated":9994240,"data_compressed_original":20480000,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100496,"kb_used_data":7048,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94271344,"statfs":{"total":96636764160,"available":96533856256,"internally_reserved":0,"allocated":7217152,"data_stored":13857330,"data_compressed":702444,"data_compressed_allocated":6557696,"data_compressed_original":13606912,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92108,"kb_used_data":11140,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94279732,"statfs":{"total":96636764160,"available":96542445568,"internally_reserved":0,"allocated":11407360,"data_stored":21783397,"data_compressed":1111859,"data_compressed_allocated":10776576,"data_compressed_original":21553152,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706243,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103356,"kb_used_data":9908,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94268484,"statfs":{"total":96636764160,"available":96530927616,"internally_reserved":0,"allocated":10145792,"data_stored":19740888,"data_compressed":1006275,"data_compressed_allocated":9502720,"data_compressed_original":19496960,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9568256,"data_stored":19136512,"data_compressed":987306,"data_compressed_allocated":9568256,"data_compressed_original":19136512,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10940416,"data_stored":21880832,"data_compressed":1128779,"data_compressed_allocated":10940416,"data_compressed_original":21880832,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6676480,"data_stored":13352960,"data_compressed":688974,"data_compressed_allocated":6676480,"data_compressed_original":13352960,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":20045824,"data_compressed":1034143,"data_compressed_allocated":10022912,"data_compressed_original":20045824,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:37:24.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 3379 3363 1.05084 1.14062 0.0761253 0.118656 2024-04-25T09:37:25.475 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 3520 3504 1.05279 1.10156 0.0846406 0.118402 2024-04-25T09:37:25.717 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:25.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:25.861+0000 7fa37819d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:25.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:25.869+0000 7fa37819d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:26.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 3660 3644 1.0543 1.09375 0.0295126 0.118195 2024-04-25T09:37:27.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 3796 3780 1.05459 1.0625 0.110956 0.118293 2024-04-25T09:37:28.057 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:28.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:28.210+0000 7fa106424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:28.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:28.218+0000 7fa106424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:28.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 3934 3918 1.0554 1.07812 0.253582 0.118194 2024-04-25T09:37:28.690 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:28.691 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:28.691 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:37:28.824 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:28.832+0000 7f5d5799d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:28.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:28.841+0000 7f5d5799d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:29.062 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:37:29.063 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:37:29.079 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-04-25T09:37:27.350243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28738080,"num_objects":433,"num_object_clones":0,"num_object_copies":1299,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":3573,"num_write_kb":29382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3518,"ondisk_log_size":3518,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":404252,"kb_used_data":42936,"kb_used_omap":0,"kb_used_meta":361280,"kb_avail":377083108,"statfs":{"total":386547056640,"available":386133102592,"internally_reserved":0,"allocated":43966464,"data_stored":85144405,"data_compressed":4343220,"data_compressed_allocated":41340928,"data_compressed_original":84156416,"omap_allocated":0,"internal_metadata":369950720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9035776,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1103,"num_write_kb":8824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.961391"},"pg_stats":[{"pgid":"8.7","version":"75'183","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.793549+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:37:21.793549+0000","last_peered":"2024-04-25T09:37:21.793549+0000","last_clean":"2024-04-25T09:37:21.793549+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:37:21.793549+0000","last_undegraded":"2024-04-25T09:37:21.793549+0000","last_fullsized":"2024-04-25T09:37:21.793549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"72'160","reported_seq":180,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.448338+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:37:21.448338+0000","last_peered":"2024-04-25T09:37:21.448338+0000","last_clean":"2024-04-25T09:37:21.448338+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:37:21.448338+0000","last_undegraded":"2024-04-25T09:37:21.448338+0000","last_fullsized":"2024-04-25T09:37:21.448338+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'192","reported_seq":216,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:26.471284+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:37:26.471284+0000","last_peered":"2024-04-25T09:37:26.471284+0000","last_clean":"2024-04-25T09:37:26.471284+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:37:26.471284+0000","last_undegraded":"2024-04-25T09:37:26.471284+0000","last_fullsized":"2024-04-25T09:37:26.471284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1581056,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":1544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'255","reported_seq":281,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:25.624906+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:37:25.624906+0000","last_peered":"2024-04-25T09:37:25.624906+0000","last_clean":"2024-04-25T09:37:25.624906+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:37:25.624906+0000","last_undegraded":"2024-04-25T09:37:25.624906+0000","last_fullsized":"2024-04-25T09:37:25.624906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'231","reported_seq":255,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:26.088624+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:37:26.088624+0000","last_peered":"2024-04-25T09:37:26.088624+0000","last_clean":"2024-04-25T09:37:26.088624+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:37:26.088624+0000","last_undegraded":"2024-04-25T09:37:26.088624+0000","last_fullsized":"2024-04-25T09:37:26.088624+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'154","reported_seq":180,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:26.480845+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:37:26.480845+0000","last_peered":"2024-04-25T09:37:26.480845+0000","last_clean":"2024-04-25T09:37:26.480845+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:37:26.480845+0000","last_undegraded":"2024-04-25T09:37:26.480845+0000","last_fullsized":"2024-04-25T09:37:26.480845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1269760,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":1240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"74'247","reported_seq":267,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.252620+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:37:22.252620+0000","last_peered":"2024-04-25T09:37:22.252620+0000","last_clean":"2024-04-25T09:37:22.252620+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:37:22.252620+0000","last_undegraded":"2024-04-25T09:37:22.252620+0000","last_fullsized":"2024-04-25T09:37:22.252620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'271","reported_seq":295,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:25.567726+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:37:25.567726+0000","last_peered":"2024-04-25T09:37:25.567726+0000","last_clean":"2024-04-25T09:37:25.567726+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:37:25.567726+0000","last_undegraded":"2024-04-25T09:37:25.567726+0000","last_fullsized":"2024-04-25T09:37:25.567726+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'223","reported_seq":249,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:24.550947+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:37:24.550947+0000","last_peered":"2024-04-25T09:37:24.550947+0000","last_clean":"2024-04-25T09:37:24.550947+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:37:24.550947+0000","last_undegraded":"2024-04-25T09:37:24.550947+0000","last_fullsized":"2024-04-25T09:37:24.550947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":302,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.622399+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:20.622399+0000","last_peered":"2024-04-25T09:37:20.622399+0000","last_clean":"2024-04-25T09:37:20.622399+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:20.622399+0000","last_undegraded":"2024-04-25T09:37:20.622399+0000","last_fullsized":"2024-04-25T09:37:20.622399+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.475691+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:22.475691+0000","last_peered":"2024-04-25T09:37:22.475691+0000","last_clean":"2024-04-25T09:37:22.475691+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:22.475691+0000","last_undegraded":"2024-04-25T09:37:22.475691+0000","last_fullsized":"2024-04-25T09:37:22.475691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"74'271","reported_seq":291,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.971501+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:37:21.971501+0000","last_peered":"2024-04-25T09:37:21.971501+0000","last_clean":"2024-04-25T09:37:21.971501+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:37:21.971501+0000","last_undegraded":"2024-04-25T09:37:21.971501+0000","last_fullsized":"2024-04-25T09:37:21.971501+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'167","reported_seq":193,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:25.724724+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:37:25.724724+0000","last_peered":"2024-04-25T09:37:25.724724+0000","last_clean":"2024-04-25T09:37:25.724724+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:37:25.724724+0000","last_undegraded":"2024-04-25T09:37:25.724724+0000","last_fullsized":"2024-04-25T09:37:25.724724+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.465006+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:22.465006+0000","last_peered":"2024-04-25T09:37:22.465006+0000","last_clean":"2024-04-25T09:37:22.465006+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:22.465006+0000","last_undegraded":"2024-04-25T09:37:22.465006+0000","last_fullsized":"2024-04-25T09:37:22.465006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'207","reported_seq":231,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:25.433050+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:37:25.433050+0000","last_peered":"2024-04-25T09:37:25.433050+0000","last_clean":"2024-04-25T09:37:25.433050+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:37:25.433050+0000","last_undegraded":"2024-04-25T09:37:25.433050+0000","last_fullsized":"2024-04-25T09:37:25.433050+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'223","reported_seq":249,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:26.317099+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:37:26.317099+0000","last_peered":"2024-04-25T09:37:26.317099+0000","last_clean":"2024-04-25T09:37:26.317099+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:37:26.317099+0000","last_undegraded":"2024-04-25T09:37:26.317099+0000","last_fullsized":"2024-04-25T09:37:26.317099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.465359+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:21.465359+0000","last_peered":"2024-04-25T09:37:21.465359+0000","last_clean":"2024-04-25T09:37:21.465359+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:21.465359+0000","last_undegraded":"2024-04-25T09:37:21.465359+0000","last_fullsized":"2024-04-25T09:37:21.465359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"74'215","reported_seq":235,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.361503+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:37:22.361503+0000","last_peered":"2024-04-25T09:37:22.361503+0000","last_clean":"2024-04-25T09:37:22.361503+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:37:22.361503+0000","last_undegraded":"2024-04-25T09:37:22.361503+0000","last_fullsized":"2024-04-25T09:37:22.361503+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-25T09:37:20.629847+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:20.629847+0000","last_peered":"2024-04-25T09:37:20.629847+0000","last_clean":"2024-04-25T09:37:20.629847+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:20.629847+0000","last_undegraded":"2024-04-25T09:37:20.629847+0000","last_fullsized":"2024-04-25T09:37:20.629847+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'183","reported_seq":209,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.768788+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:37:22.768788+0000","last_peered":"2024-04-25T09:37:22.768788+0000","last_clean":"2024-04-25T09:37:22.768788+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:37:22.768788+0000","last_undegraded":"2024-04-25T09:37:22.768788+0000","last_fullsized":"2024-04-25T09:37:22.768788+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:21.476056+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:21.476056+0000","last_peered":"2024-04-25T09:37:21.476056+0000","last_clean":"2024-04-25T09:37:21.476056+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:21.476056+0000","last_undegraded":"2024-04-25T09:37:21.476056+0000","last_fullsized":"2024-04-25T09:37:21.476056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'239","reported_seq":265,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:26.046473+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:37:26.046473+0000","last_peered":"2024-04-25T09:37:26.046473+0000","last_clean":"2024-04-25T09:37:26.046473+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:37:26.046473+0000","last_undegraded":"2024-04-25T09:37:26.046473+0000","last_fullsized":"2024-04-25T09:37:26.046473+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":28147712,"num_objects":431,"num_object_clones":0,"num_object_copies":1293,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3436,"num_write_kb":27488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41676800,"data_stored":83353600,"data_compressed":4300695,"data_compressed_allocated":41676800,"data_compressed_original":83353600,"omap_allocated":0,"internal_metadata":0},"log_size":3421,"ondisk_log_size":3421,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99684,"kb_used_data":10396,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94272156,"statfs":{"total":96636764160,"available":96534687744,"internally_reserved":0,"allocated":10645504,"data_stored":20727173,"data_compressed":1056919,"data_compressed_allocated":9994240,"data_compressed_original":20480000,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673539,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100496,"kb_used_data":7048,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94271344,"statfs":{"total":96636764160,"available":96533856256,"internally_reserved":0,"allocated":7217152,"data_stored":13857330,"data_compressed":702444,"data_compressed_allocated":6557696,"data_compressed_original":13606912,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98688,"kb_used_data":13556,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94273152,"statfs":{"total":96636764160,"available":96535707648,"internally_reserved":0,"allocated":13881344,"data_stored":26705087,"data_compressed":1365659,"data_compressed_allocated":13234176,"data_compressed_original":26468352,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105384,"kb_used_data":11936,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94266456,"statfs":{"total":96636764160,"available":96528850944,"internally_reserved":0,"allocated":12222464,"data_stored":23854815,"data_compressed":1218198,"data_compressed_allocated":11554816,"data_compressed_original":23601152,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":23166976,"data_compressed":1195422,"data_compressed_allocated":11583488,"data_compressed_original":23166976,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13393920,"data_stored":26787840,"data_compressed":1382156,"data_compressed_allocated":13393920,"data_compressed_original":26787840,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6676480,"data_stored":13352960,"data_compressed":688974,"data_compressed_allocated":6676480,"data_compressed_original":13352960,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10022912,"data_stored":20045824,"data_compressed":1034143,"data_compressed_allocated":10022912,"data_compressed_original":20045824,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:37:29.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4065 4049 1.05433 1.02344 0.135889 0.118244 2024-04-25T09:37:30.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:30.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4203 4187 1.0551 1.07812 0.10897 0.118169 2024-04-25T09:37:30.520 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:30.530+0000 7f45d3b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:30.525 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:30.537+0000 7f45d3b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:31.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 4337 4321 1.05484 1.04688 0.112162 0.118236 2024-04-25T09:37:32.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 4464 4448 1.05294 0.992188 0.195236 0.118439 2024-04-25T09:37:32.779 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:32.917 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:32.927+0000 7f884e66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:32.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:32.934+0000 7f884e66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:33.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 4591 4575 1.05115 0.992188 0.0378861 0.118678 2024-04-25T09:37:34.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:34.081 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:34.081 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:37:34.081 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:37:34.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.215+0000 7f76a0e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.217 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.229+0000 7f76a0e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.279 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:34.279 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:34.279 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:34.279 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:34.279 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:34.279 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:34.280 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:34.280 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:34.280 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:34.280 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:34.280 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:34.280 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:34.283 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:34.283 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:34.283 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:37:34.429 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.433+0000 7fd0fad54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.446+0000 7fd0fad54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.476 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 4739 4723 1.05415 1.15625 0.0496571 0.118377 2024-04-25T09:37:34.563 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:34.563 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:34.563 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:34.564 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:34.567 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:34.568 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:34.568 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:37:34.693 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.699+0000 7f7e564ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.710+0000 7f7e564ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:34.716 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:34.717 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:34.717 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:34.717 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:34.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:34.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:34.720 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:37:34.848 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.854+0000 7f625519d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.853 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:34.865+0000 7f625519d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:34.975 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:34.976 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:34.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:34.979 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:35.104 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:35.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:35.244+0000 7fcce751d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:35.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:35.250+0000 7fcce751d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:35.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 4874 4858 1.05416 1.05469 0.0991977 0.118317 2024-04-25T09:37:36.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5003 4987 1.0529 1.00781 0.0713343 0.118459 2024-04-25T09:37:37.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5145 5129 1.05439 1.10938 0.171762 0.118345 2024-04-25T09:37:37.513 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:37.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:37.661+0000 7f86de86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:37.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:37.669+0000 7f86de86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:38.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 5289 5273 1.0562 1.125 0.0923135 0.118108 2024-04-25T09:37:39.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:37:39.490214+0000 min lat: 0.0155076 max lat: 0.424869 avg lat: 0.118214 2024-04-25T09:37:39.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:37:39.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 5422 5406 1.05577 1.03906 0.0976904 0.118214 2024-04-25T09:37:39.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:39.979 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:39.980 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:39.980 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:37:39.980 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:37:40.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.032+0000 7fb54086d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.027 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.039+0000 7fb54086d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.121 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.127+0000 7f97706ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.125 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.137+0000 7f97706ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.143 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:40.144 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:40.147 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:40.147 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:40.147 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:37:40.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.333+0000 7f87e2a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.344+0000 7f87e2a64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:40.460 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:40.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:40.465 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:40.465 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:37:40.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 5558 5542 1.05593 1.0625 0.0819382 0.118165 2024-04-25T09:37:40.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.606+0000 7fcfe20ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.617+0000 7fcfe20ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.628 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:40.629 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:40.633 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:40.634 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:40.634 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:37:40.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.809+0000 7f68a459d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.811 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:40.823+0000 7f68a459d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:40.847 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:40.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:40.852 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:41.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 5696 5680 1.05645 1.07812 0.15631 0.118156 2024-04-25T09:37:42.265 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:42.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:42.419+0000 7f33d8b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:42.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:42.427+0000 7f33d8b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:42.477 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 5839 5823 1.05786 1.11719 0.100393 0.117958 2024-04-25T09:37:43.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 5967 5951 1.05655 1 0.0540263 0.1181 2024-04-25T09:37:44.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 15 6106 6091 1.05737 1.09375 0.0902197 0.118062 2024-04-25T09:37:44.578 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:44.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:44.722+0000 7f0f9659d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:44.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:44.729+0000 7f0f9659d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:45.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 6227 6211 1.05476 0.9375 0.0660704 0.118304 2024-04-25T09:37:45.852 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:45.852 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:45.853 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:37:45.980 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:45.987+0000 7f5b93b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:45.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:45.997+0000 7f5b93b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:46.228 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:37:46.228 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:37:46.245 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-04-25T09:37:45.354258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":47489568,"num_objects":719,"num_object_clones":0,"num_object_copies":2157,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5862,"num_write_kb":47694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5806,"ondisk_log_size":5806,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":425716,"kb_used_data":71308,"kb_used_omap":0,"kb_used_meta":354368,"kb_avail":377061644,"statfs":{"total":386547056640,"available":386111123456,"internally_reserved":0,"allocated":73019392,"data_stored":143210844,"data_compressed":7341021,"data_compressed_allocated":70369280,"data_compressed_original":142213120,"omap_allocated":0,"internal_metadata":362872832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10805248,"num_objects":165,"num_object_clones":0,"num_object_copies":495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1319,"num_write_kb":10552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002751"},"pg_stats":[{"pgid":"8.7","version":"76'463","reported_seq":487,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:42.246440+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:37:42.246440+0000","last_peered":"2024-04-25T09:37:42.246440+0000","last_clean":"2024-04-25T09:37:42.246440+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:37:42.246440+0000","last_undegraded":"2024-04-25T09:37:42.246440+0000","last_fullsized":"2024-04-25T09:37:42.246440+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'367","reported_seq":391,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:40.876861+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:37:40.876861+0000","last_peered":"2024-04-25T09:37:40.876861+0000","last_clean":"2024-04-25T09:37:40.876861+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:37:40.876861+0000","last_undegraded":"2024-04-25T09:37:40.876861+0000","last_fullsized":"2024-04-25T09:37:40.876861+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'335","reported_seq":359,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:40.721996+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:37:40.721996+0000","last_peered":"2024-04-25T09:37:40.721996+0000","last_clean":"2024-04-25T09:37:40.721996+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:37:40.721996+0000","last_undegraded":"2024-04-25T09:37:40.721996+0000","last_fullsized":"2024-04-25T09:37:40.721996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'367","reported_seq":393,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.250054+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:37:41.250054+0000","last_peered":"2024-04-25T09:37:41.250054+0000","last_clean":"2024-04-25T09:37:41.250054+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:37:41.250054+0000","last_undegraded":"2024-04-25T09:37:41.250054+0000","last_fullsized":"2024-04-25T09:37:41.250054+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'319","reported_seq":343,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.380410+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:37:41.380410+0000","last_peered":"2024-04-25T09:37:41.380410+0000","last_clean":"2024-04-25T09:37:41.380410+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:37:41.380410+0000","last_undegraded":"2024-04-25T09:37:41.380410+0000","last_fullsized":"2024-04-25T09:37:41.380410+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'282","reported_seq":308,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.471956+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:37:41.471956+0000","last_peered":"2024-04-25T09:37:41.471956+0000","last_clean":"2024-04-25T09:37:41.471956+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:37:41.471956+0000","last_undegraded":"2024-04-25T09:37:41.471956+0000","last_fullsized":"2024-04-25T09:37:41.471956+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2318336,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":2264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'495","reported_seq":519,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:42.128527+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:37:42.128527+0000","last_peered":"2024-04-25T09:37:42.128527+0000","last_clean":"2024-04-25T09:37:42.128527+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:37:42.128527+0000","last_undegraded":"2024-04-25T09:37:42.128527+0000","last_fullsized":"2024-04-25T09:37:42.128527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'383","reported_seq":407,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.107554+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:37:41.107554+0000","last_peered":"2024-04-25T09:37:41.107554+0000","last_clean":"2024-04-25T09:37:41.107554+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:37:41.107554+0000","last_undegraded":"2024-04-25T09:37:41.107554+0000","last_fullsized":"2024-04-25T09:37:41.107554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'343","reported_seq":369,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.382697+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:37:41.382697+0000","last_peered":"2024-04-25T09:37:41.382697+0000","last_clean":"2024-04-25T09:37:41.382697+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:37:41.382697+0000","last_undegraded":"2024-04-25T09:37:41.382697+0000","last_fullsized":"2024-04-25T09:37:41.382697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.475691+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:22.475691+0000","last_peered":"2024-04-25T09:37:22.475691+0000","last_clean":"2024-04-25T09:37:22.475691+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:22.475691+0000","last_undegraded":"2024-04-25T09:37:22.475691+0000","last_fullsized":"2024-04-25T09:37:22.475691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'423","reported_seq":447,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.858397+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:37:41.858397+0000","last_peered":"2024-04-25T09:37:41.858397+0000","last_clean":"2024-04-25T09:37:41.858397+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:37:41.858397+0000","last_undegraded":"2024-04-25T09:37:41.858397+0000","last_fullsized":"2024-04-25T09:37:41.858397+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'303","reported_seq":329,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.073431+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:37:41.073431+0000","last_peered":"2024-04-25T09:37:41.073431+0000","last_clean":"2024-04-25T09:37:41.073431+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:37:41.073431+0000","last_undegraded":"2024-04-25T09:37:41.073431+0000","last_fullsized":"2024-04-25T09:37:41.073431+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.465006+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:22.465006+0000","last_peered":"2024-04-25T09:37:22.465006+0000","last_clean":"2024-04-25T09:37:22.465006+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:22.465006+0000","last_undegraded":"2024-04-25T09:37:22.465006+0000","last_fullsized":"2024-04-25T09:37:22.465006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'339","reported_seq":363,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.465829+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:37:41.465829+0000","last_peered":"2024-04-25T09:37:41.465829+0000","last_clean":"2024-04-25T09:37:41.465829+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:37:41.465829+0000","last_undegraded":"2024-04-25T09:37:41.465829+0000","last_fullsized":"2024-04-25T09:37:41.465829+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2785280,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":340,"num_write_kb":2720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'287","reported_seq":313,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.138168+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:37:41.138168+0000","last_peered":"2024-04-25T09:37:41.138168+0000","last_clean":"2024-04-25T09:37:41.138168+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:37:41.138168+0000","last_undegraded":"2024-04-25T09:37:41.138168+0000","last_fullsized":"2024-04-25T09:37:41.138168+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'367","reported_seq":391,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.709447+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:37:41.709447+0000","last_peered":"2024-04-25T09:37:41.709447+0000","last_clean":"2024-04-25T09:37:41.709447+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:37:41.709447+0000","last_undegraded":"2024-04-25T09:37:41.709447+0000","last_fullsized":"2024-04-25T09:37:41.709447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'319","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:39.388866+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:37:39.388866+0000","last_peered":"2024-04-25T09:37:39.388866+0000","last_clean":"2024-04-25T09:37:39.388866+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:37:39.388866+0000","last_undegraded":"2024-04-25T09:37:39.388866+0000","last_fullsized":"2024-04-25T09:37:39.388866+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'317","reported_seq":343,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:41.433455+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:37:41.433455+0000","last_peered":"2024-04-25T09:37:41.433455+0000","last_clean":"2024-04-25T09:37:41.433455+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:37:41.433455+0000","last_undegraded":"2024-04-25T09:37:41.433455+0000","last_fullsized":"2024-04-25T09:37:41.433455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2605056,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":2544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":46899200,"num_objects":717,"num_object_clones":0,"num_object_copies":2151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5725,"num_write_kb":45800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":70680576,"data_stored":141361152,"data_compressed":7295958,"data_compressed_allocated":70680576,"data_compressed_original":141361152,"omap_allocated":0,"internal_metadata":0},"log_size":5709,"ondisk_log_size":5709,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117508,"kb_used_data":18488,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94254332,"statfs":{"total":96636764160,"available":96516435968,"internally_reserved":0,"allocated":18931712,"data_stored":37273311,"data_compressed":1910956,"data_compressed_allocated":18264064,"data_compressed_original":37019648,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94628,"kb_used_data":13660,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94277212,"statfs":{"total":96636764160,"available":96539865088,"internally_reserved":0,"allocated":13987840,"data_stored":27385567,"data_compressed":1400817,"data_compressed_allocated":13320192,"data_compressed_original":27131904,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110044,"kb_used_data":20752,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94261796,"statfs":{"total":96636764160,"available":96524079104,"internally_reserved":0,"allocated":21250048,"data_stored":41442495,"data_compressed":2126636,"data_compressed_allocated":20602880,"data_compressed_original":41205760,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103536,"kb_used_data":18408,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94268304,"statfs":{"total":96636764160,"available":96530743296,"internally_reserved":0,"allocated":18849792,"data_stored":37109471,"data_compressed":1902612,"data_compressed_allocated":18182144,"data_compressed_original":36855808,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18276352,"data_stored":36552704,"data_compressed":1886604,"data_compressed_allocated":18276352,"data_compressed_original":36552704,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20717568,"data_stored":41435136,"data_compressed":2138480,"data_compressed_allocated":20717568,"data_compressed_original":41435136,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13365248,"data_stored":26730496,"data_compressed":1379733,"data_compressed_allocated":13365248,"data_compressed_original":26730496,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18321408,"data_stored":36642816,"data_compressed":1891141,"data_compressed_allocated":18321408,"data_compressed_original":36642816,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:37:46.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 6346 6330 1.0521 0.929688 0.135391 0.118601 2024-04-25T09:37:46.858 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:46.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:46.994+0000 7f51e719d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:46.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:47.002+0000 7f51e719d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:47.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 6474 6458 1.05101 1 0.062695 0.118763 2024-04-25T09:37:48.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 6606 6590 1.05061 1.03125 0.242397 0.118821 2024-04-25T09:37:49.218 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:49.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:49.348+0000 7f5183b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:49.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:49.355+0000 7f5183b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:49.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 6744 6728 1.05116 1.07812 0.0364118 0.118631 2024-04-25T09:37:50.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 6879 6863 1.05122 1.05469 0.166141 0.118759 2024-04-25T09:37:51.247 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:51.247 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:51.248 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:37:51.248 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:37:51.406 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.412+0000 7f475cead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.423+0000 7f475cead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.451 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:51.452 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:51.455 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:51.455 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:51.456 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:37:51.470 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:51.478 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 7010 6994 1.05069 1.02344 0.175149 0.118797 2024-04-25T09:37:51.598 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.603+0000 7ff6f886d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.611+0000 7f5942aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.614+0000 7ff6f886d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.607 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.619+0000 7f5942aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:51.653 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:51.654 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:51.654 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:51.657 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:51.657 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:51.657 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:37:51.779 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.784+0000 7f7087c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.785 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.797+0000 7f7087c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:51.805 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:51.808 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:51.809 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:51.809 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:37:51.972 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.978+0000 7f86ce42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:51.977 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:51.988+0000 7f86ce42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:52.082 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:37:52.082 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:37:52.082 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:37:52.083 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:37:52.086 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:37:52.087 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:37:52.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 7103 7087 1.04457 0.726562 0.0310625 0.119469 2024-04-25T09:37:53.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 7235 7219 1.04432 1.03125 0.180509 0.119495 2024-04-25T09:37:53.759 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:53.879 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:53.889+0000 7f218259d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:53.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:53.895+0000 7f218259d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:54.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 7368 7352 1.04422 1.03906 0.122834 0.119555 2024-04-25T09:37:55.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 7485 7469 1.0419 0.914062 0.248459 0.119793 2024-04-25T09:37:56.034 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:37:56.185 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:56.194+0000 7f06e83ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:56.192 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:56.204+0000 7f06e83ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:56.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 7615 7599 1.04144 1.01562 0.211377 0.119814 2024-04-25T09:37:57.088 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:37:57.088 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:37:57.088 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:37:57.227 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:57.232+0000 7ff8e375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:57.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:57.243+0000 7ff8e375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:57.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 7748 7732 1.04139 1.03906 0.185257 0.119816 2024-04-25T09:37:57.537 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:37:57.538 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:37:57.553 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":377,"stamp":"2024-04-25T09:37:57.356745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":61637152,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7589,"num_write_kb":61510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7533,"ondisk_log_size":7533,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":471648,"kb_used_data":90876,"kb_used_omap":0,"kb_used_meta":380736,"kb_avail":377015712,"statfs":{"total":386547056640,"available":386064089088,"internally_reserved":0,"allocated":93057024,"data_stored":183286108,"data_compressed":9410337,"data_compressed_allocated":90406912,"data_compressed_original":182288384,"omap_allocated":0,"internal_metadata":389873664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14147584,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1727,"num_write_kb":13816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002486"},"pg_stats":[{"pgid":"8.7","version":"76'521","reported_seq":545,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:52.464988+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:37:52.464988+0000","last_peered":"2024-04-25T09:37:52.464988+0000","last_clean":"2024-04-25T09:37:52.464988+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:37:52.464988+0000","last_undegraded":"2024-04-25T09:37:52.464988+0000","last_fullsized":"2024-04-25T09:37:52.464988+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4276224,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":4176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'447","reported_seq":471,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:51.199170+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:37:51.199170+0000","last_peered":"2024-04-25T09:37:51.199170+0000","last_clean":"2024-04-25T09:37:51.199170+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:37:51.199170+0000","last_undegraded":"2024-04-25T09:37:51.199170+0000","last_fullsized":"2024-04-25T09:37:51.199170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'449","reported_seq":473,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.440805+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:37:56.440805+0000","last_peered":"2024-04-25T09:37:56.440805+0000","last_clean":"2024-04-25T09:37:56.440805+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:37:56.440805+0000","last_undegraded":"2024-04-25T09:37:56.440805+0000","last_fullsized":"2024-04-25T09:37:56.440805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3686400,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":3600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'487","reported_seq":513,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.442774+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:37:56.442774+0000","last_peered":"2024-04-25T09:37:56.442774+0000","last_clean":"2024-04-25T09:37:56.442774+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:37:56.442774+0000","last_undegraded":"2024-04-25T09:37:56.442774+0000","last_fullsized":"2024-04-25T09:37:56.442774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'415","reported_seq":439,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.894477+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:37:55.894477+0000","last_peered":"2024-04-25T09:37:55.894477+0000","last_clean":"2024-04-25T09:37:55.894477+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:37:55.894477+0000","last_undegraded":"2024-04-25T09:37:55.894477+0000","last_fullsized":"2024-04-25T09:37:55.894477+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'415","reported_seq":441,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.295194+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:37:56.295194+0000","last_peered":"2024-04-25T09:37:56.295194+0000","last_clean":"2024-04-25T09:37:56.295194+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:37:56.295194+0000","last_undegraded":"2024-04-25T09:37:56.295194+0000","last_fullsized":"2024-04-25T09:37:56.295194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'583","reported_seq":607,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:50.382476+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:37:50.382476+0000","last_peered":"2024-04-25T09:37:50.382476+0000","last_clean":"2024-04-25T09:37:50.382476+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:37:50.382476+0000","last_undegraded":"2024-04-25T09:37:50.382476+0000","last_fullsized":"2024-04-25T09:37:50.382476+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'487","reported_seq":511,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.799630+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:37:55.799630+0000","last_peered":"2024-04-25T09:37:55.799630+0000","last_clean":"2024-04-25T09:37:55.799630+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:37:55.799630+0000","last_undegraded":"2024-04-25T09:37:55.799630+0000","last_fullsized":"2024-04-25T09:37:55.799630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'495","reported_seq":521,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.951980+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:37:55.951980+0000","last_peered":"2024-04-25T09:37:55.951980+0000","last_clean":"2024-04-25T09:37:55.951980+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:37:55.951980+0000","last_undegraded":"2024-04-25T09:37:55.951980+0000","last_fullsized":"2024-04-25T09:37:55.951980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.475691+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:22.475691+0000","last_peered":"2024-04-25T09:37:22.475691+0000","last_clean":"2024-04-25T09:37:22.475691+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:22.475691+0000","last_undegraded":"2024-04-25T09:37:22.475691+0000","last_fullsized":"2024-04-25T09:37:22.475691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'491","reported_seq":515,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:52.458653+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:37:52.458653+0000","last_peered":"2024-04-25T09:37:52.458653+0000","last_clean":"2024-04-25T09:37:52.458653+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:37:52.458653+0000","last_undegraded":"2024-04-25T09:37:52.458653+0000","last_fullsized":"2024-04-25T09:37:52.458653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4030464,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":492,"num_write_kb":3936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'399","reported_seq":425,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.229567+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:37:56.229567+0000","last_peered":"2024-04-25T09:37:56.229567+0000","last_clean":"2024-04-25T09:37:56.229567+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:37:56.229567+0000","last_undegraded":"2024-04-25T09:37:56.229567+0000","last_fullsized":"2024-04-25T09:37:56.229567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.465006+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:22.465006+0000","last_peered":"2024-04-25T09:37:22.465006+0000","last_clean":"2024-04-25T09:37:22.465006+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:22.465006+0000","last_undegraded":"2024-04-25T09:37:22.465006+0000","last_fullsized":"2024-04-25T09:37:22.465006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'503","reported_seq":527,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.131365+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:37:55.131365+0000","last_peered":"2024-04-25T09:37:55.131365+0000","last_clean":"2024-04-25T09:37:55.131365+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:37:55.131365+0000","last_undegraded":"2024-04-25T09:37:55.131365+0000","last_fullsized":"2024-04-25T09:37:55.131365+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'383","reported_seq":409,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.022847+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:37:55.022847+0000","last_peered":"2024-04-25T09:37:55.022847+0000","last_clean":"2024-04-25T09:37:55.022847+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:37:55.022847+0000","last_undegraded":"2024-04-25T09:37:55.022847+0000","last_fullsized":"2024-04-25T09:37:55.022847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'447","reported_seq":471,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:50.753638+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:37:50.753638+0000","last_peered":"2024-04-25T09:37:50.753638+0000","last_clean":"2024-04-25T09:37:50.753638+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:37:50.753638+0000","last_undegraded":"2024-04-25T09:37:50.753638+0000","last_fullsized":"2024-04-25T09:37:50.753638+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'447","reported_seq":473,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.079644+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:37:56.079644+0000","last_peered":"2024-04-25T09:37:56.079644+0000","last_clean":"2024-04-25T09:37:56.079644+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:37:56.079644+0000","last_undegraded":"2024-04-25T09:37:56.079644+0000","last_fullsized":"2024-04-25T09:37:56.079644+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'467","reported_seq":493,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.467234+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:37:56.467234+0000","last_peered":"2024-04-25T09:37:56.467234+0000","last_clean":"2024-04-25T09:37:56.467234+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:37:56.467234+0000","last_undegraded":"2024-04-25T09:37:56.467234+0000","last_fullsized":"2024-04-25T09:37:56.467234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3833856,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":3744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":61046784,"num_objects":934,"num_object_clones":0,"num_object_copies":2802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7452,"num_write_kb":59616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90607616,"data_stored":181215232,"data_compressed":9353853,"data_compressed_allocated":90607616,"data_compressed_original":181215232,"omap_allocated":0,"internal_metadata":0},"log_size":7436,"ondisk_log_size":7436,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125536,"kb_used_data":22360,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94246304,"statfs":{"total":96636764160,"available":96508215296,"internally_reserved":0,"allocated":22896640,"data_stored":45203167,"data_compressed":2320420,"data_compressed_allocated":22228992,"data_compressed_original":44949504,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101584,"kb_used_data":16456,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94270256,"statfs":{"total":96636764160,"available":96532742144,"internally_reserved":0,"allocated":16850944,"data_stored":33111775,"data_compressed":1696494,"data_compressed_allocated":16183296,"data_compressed_original":32858112,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126316,"kb_used_data":27296,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94245524,"statfs":{"total":96636764160,"available":96507416576,"internally_reserved":0,"allocated":27951104,"data_stored":54844607,"data_compressed":2818664,"data_compressed_allocated":27303936,"data_compressed_original":54607872,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118212,"kb_used_data":24764,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94253628,"statfs":{"total":96636764160,"available":96515715072,"internally_reserved":0,"allocated":25358336,"data_stored":50126559,"data_compressed":2574759,"data_compressed_allocated":24690688,"data_compressed_original":49872896,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24731648,"data_stored":49463296,"data_compressed":2553252,"data_compressed_allocated":24731648,"data_compressed_original":49463296,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27410432,"data_stored":54820864,"data_compressed":2829662,"data_compressed_allocated":27410432,"data_compressed_original":54820864,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16207872,"data_stored":32415744,"data_compressed":1673295,"data_compressed_allocated":16207872,"data_compressed_original":32415744,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22257664,"data_stored":44515328,"data_compressed":2297644,"data_compressed_allocated":22257664,"data_compressed_original":44515328,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:37:58.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:37:58.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 7873 7857 1.04029 0.976562 0.106159 0.119982 2024-04-25T09:37:58.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:58.548+0000 7feee9a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:58.543 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:37:58.555+0000 7feee9a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:37:59.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:37:59.492020+0000 min lat: 0.0155076 max lat: 0.424869 avg lat: 0.12008 2024-04-25T09:37:59.479 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:37:59.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 8003 7987 1.03988 1.01562 0.131696 0.12008 2024-04-25T09:38:00.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 8159 8143 1.04281 1.21875 0.1559 0.119741 2024-04-25T09:38:00.694 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:00.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:00.827+0000 7fef41d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:00.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:00.833+0000 7fef41d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:01.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 8271 8255 1.0401 0.875 0.172699 0.120027 2024-04-25T09:38:02.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 8410 8394 1.04083 1.08594 0.174667 0.119985 2024-04-25T09:38:02.556 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:02.556 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:02.556 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:02.689 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:02.694+0000 7fed0186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:02.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:02.705+0000 7fed0186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:02.943 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:02.943 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:02.962 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2024-04-25T09:38:01.357531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63095328,"num_objects":957,"num_object_clones":0,"num_object_copies":2871,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7767,"num_write_kb":62934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7711,"ondisk_log_size":7711,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":479196,"kb_used_data":94264,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377008164,"statfs":{"total":386547056640,"available":386056359936,"internally_reserved":0,"allocated":96526336,"data_stored":190224732,"data_compressed":9768618,"data_compressed_allocated":93876224,"data_compressed_original":189227008,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10272768,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1254,"num_write_kb":10032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002428"},"pg_stats":[{"pgid":"8.7","version":"76'575","reported_seq":599,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:57.413888+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:37:57.413888+0000","last_peered":"2024-04-25T09:37:57.413888+0000","last_clean":"2024-04-25T09:37:57.413888+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:37:57.413888+0000","last_undegraded":"2024-04-25T09:37:57.413888+0000","last_fullsized":"2024-04-25T09:37:57.413888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'479","reported_seq":503,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.138050+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:37:56.138050+0000","last_peered":"2024-04-25T09:37:56.138050+0000","last_clean":"2024-04-25T09:37:56.138050+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:37:56.138050+0000","last_undegraded":"2024-04-25T09:37:56.138050+0000","last_fullsized":"2024-04-25T09:37:56.138050+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'449","reported_seq":473,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.440805+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:37:56.440805+0000","last_peered":"2024-04-25T09:37:56.440805+0000","last_clean":"2024-04-25T09:37:56.440805+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:37:56.440805+0000","last_undegraded":"2024-04-25T09:37:56.440805+0000","last_fullsized":"2024-04-25T09:37:56.440805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3686400,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":450,"num_write_kb":3600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'487","reported_seq":513,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.442774+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:37:56.442774+0000","last_peered":"2024-04-25T09:37:56.442774+0000","last_clean":"2024-04-25T09:37:56.442774+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:37:56.442774+0000","last_undegraded":"2024-04-25T09:37:56.442774+0000","last_fullsized":"2024-04-25T09:37:56.442774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'415","reported_seq":439,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.894477+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:37:55.894477+0000","last_peered":"2024-04-25T09:37:55.894477+0000","last_clean":"2024-04-25T09:37:55.894477+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:37:55.894477+0000","last_undegraded":"2024-04-25T09:37:55.894477+0000","last_fullsized":"2024-04-25T09:37:55.894477+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'415","reported_seq":441,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.295194+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:37:56.295194+0000","last_peered":"2024-04-25T09:37:56.295194+0000","last_clean":"2024-04-25T09:37:56.295194+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:37:56.295194+0000","last_undegraded":"2024-04-25T09:37:56.295194+0000","last_fullsized":"2024-04-25T09:37:56.295194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'607","reported_seq":631,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.823086+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:37:56.823086+0000","last_peered":"2024-04-25T09:37:56.823086+0000","last_clean":"2024-04-25T09:37:56.823086+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:37:56.823086+0000","last_undegraded":"2024-04-25T09:37:56.823086+0000","last_fullsized":"2024-04-25T09:37:56.823086+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'487","reported_seq":511,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.799630+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:37:55.799630+0000","last_peered":"2024-04-25T09:37:55.799630+0000","last_clean":"2024-04-25T09:37:55.799630+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:37:55.799630+0000","last_undegraded":"2024-04-25T09:37:55.799630+0000","last_fullsized":"2024-04-25T09:37:55.799630+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'495","reported_seq":521,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.951980+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:37:55.951980+0000","last_peered":"2024-04-25T09:37:55.951980+0000","last_clean":"2024-04-25T09:37:55.951980+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:37:55.951980+0000","last_undegraded":"2024-04-25T09:37:55.951980+0000","last_fullsized":"2024-04-25T09:37:55.951980+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.475691+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:22.475691+0000","last_peered":"2024-04-25T09:37:22.475691+0000","last_clean":"2024-04-25T09:37:22.475691+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:22.475691+0000","last_undegraded":"2024-04-25T09:37:22.475691+0000","last_fullsized":"2024-04-25T09:37:22.475691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'535","reported_seq":559,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.496549+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:37:56.496549+0000","last_peered":"2024-04-25T09:37:56.496549+0000","last_clean":"2024-04-25T09:37:56.496549+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:37:56.496549+0000","last_undegraded":"2024-04-25T09:37:56.496549+0000","last_fullsized":"2024-04-25T09:37:56.496549+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'399","reported_seq":425,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.229567+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:37:56.229567+0000","last_peered":"2024-04-25T09:37:56.229567+0000","last_clean":"2024-04-25T09:37:56.229567+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:37:56.229567+0000","last_undegraded":"2024-04-25T09:37:56.229567+0000","last_fullsized":"2024-04-25T09:37:56.229567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.465006+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:22.465006+0000","last_peered":"2024-04-25T09:37:22.465006+0000","last_clean":"2024-04-25T09:37:22.465006+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:22.465006+0000","last_undegraded":"2024-04-25T09:37:22.465006+0000","last_fullsized":"2024-04-25T09:37:22.465006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'503","reported_seq":527,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.131365+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:37:55.131365+0000","last_peered":"2024-04-25T09:37:55.131365+0000","last_clean":"2024-04-25T09:37:55.131365+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:37:55.131365+0000","last_undegraded":"2024-04-25T09:37:55.131365+0000","last_fullsized":"2024-04-25T09:37:55.131365+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'383","reported_seq":409,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:55.022847+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:37:55.022847+0000","last_peered":"2024-04-25T09:37:55.022847+0000","last_clean":"2024-04-25T09:37:55.022847+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:37:55.022847+0000","last_undegraded":"2024-04-25T09:37:55.022847+0000","last_fullsized":"2024-04-25T09:37:55.022847+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'471","reported_seq":495,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:54.014622+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:37:54.014622+0000","last_peered":"2024-04-25T09:37:54.014622+0000","last_clean":"2024-04-25T09:37:54.014622+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:37:54.014622+0000","last_undegraded":"2024-04-25T09:37:54.014622+0000","last_fullsized":"2024-04-25T09:37:54.014622+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'447","reported_seq":473,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.079644+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:37:56.079644+0000","last_peered":"2024-04-25T09:37:56.079644+0000","last_clean":"2024-04-25T09:37:56.079644+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:37:56.079644+0000","last_undegraded":"2024-04-25T09:37:56.079644+0000","last_fullsized":"2024-04-25T09:37:56.079644+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'467","reported_seq":493,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:56.467234+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:37:56.467234+0000","last_peered":"2024-04-25T09:37:56.467234+0000","last_clean":"2024-04-25T09:37:56.467234+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:37:56.467234+0000","last_undegraded":"2024-04-25T09:37:56.467234+0000","last_fullsized":"2024-04-25T09:37:56.467234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3833856,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":468,"num_write_kb":3744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":62504960,"num_objects":955,"num_object_clones":0,"num_object_copies":2865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7630,"num_write_kb":61040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94109696,"data_stored":188219392,"data_compressed":9715518,"data_compressed_allocated":94109696,"data_compressed_original":188219392,"omap_allocated":0,"internal_metadata":0},"log_size":7614,"ondisk_log_size":7614,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131624,"kb_used_data":24288,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94240216,"statfs":{"total":96636764160,"available":96501981184,"internally_reserved":0,"allocated":24870912,"data_stored":49151711,"data_compressed":2524306,"data_compressed_allocated":24203264,"data_compressed_original":48898048,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103044,"kb_used_data":17916,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94268796,"statfs":{"total":96636764160,"available":96531247104,"internally_reserved":0,"allocated":18345984,"data_stored":36101855,"data_compressed":1850889,"data_compressed_allocated":17678336,"data_compressed_original":35848192,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126316,"kb_used_data":27296,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94245524,"statfs":{"total":96636764160,"available":96507416576,"internally_reserved":0,"allocated":27951104,"data_stored":54844607,"data_compressed":2818664,"data_compressed_allocated":27303936,"data_compressed_original":54607872,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118212,"kb_used_data":24764,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94253628,"statfs":{"total":96636764160,"available":96515715072,"internally_reserved":0,"allocated":25358336,"data_stored":50126559,"data_compressed":2574759,"data_compressed_allocated":24690688,"data_compressed_original":49872896,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24731648,"data_stored":49463296,"data_compressed":2553252,"data_compressed_allocated":24731648,"data_compressed_original":49463296,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27410432,"data_stored":54820864,"data_compressed":2829662,"data_compressed_allocated":27410432,"data_compressed_original":54820864,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17752064,"data_stored":35504128,"data_compressed":1832766,"data_compressed_allocated":17752064,"data_compressed_original":35504128,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24215552,"data_stored":48431104,"data_compressed":2499838,"data_compressed_allocated":24215552,"data_compressed_original":48431104,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:02.989 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:03.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:03.122+0000 7f7bfbced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:03.118 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:03.129+0000 7f7bfbced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:03.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 8519 8503 1.03787 0.851562 0.0406266 0.120216 2024-04-25T09:38:04.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 8638 8622 1.03621 0.929688 0.166592 0.120509 2024-04-25T09:38:05.275 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:05.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:05.400+0000 7fa99260f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:05.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:05.407+0000 7fa99260f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:05.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 8756 8740 1.03447 0.921875 0.245871 0.120591 2024-04-25T09:38:06.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 8890 8874 1.03466 1.04688 0.0840709 0.120702 2024-04-25T09:38:07.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 9022 9006 1.0346 1.03125 0.161376 0.120711 2024-04-25T09:38:07.589 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:07.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:07.723+0000 7fa2df22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:07.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:07.729+0000 7fa2df22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:07.964 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:07.964 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:07.964 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:38:07.964 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:38:08.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.102+0000 7f609059d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.102 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.113+0000 7f609059d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.133 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:08.134 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:08.137 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:08.138 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:08.138 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:38:08.277 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.279+0000 7f65e802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.292+0000 7f65e802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.312 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:08.312 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:08.312 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:08.316 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:08.317 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:08.317 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:38:08.458 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.461+0000 7f7531664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.463 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.474+0000 7f7531664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.480 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 9135 9119 1.0324 0.882812 0.145638 0.120955 2024-04-25T09:38:08.482 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:08.483 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:08.486 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:08.486 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:08.486 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:38:08.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.617+0000 7fc64b06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.617 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:08.628+0000 7fc64b06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:08.643 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:08.644 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:08.644 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:08.647 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:08.647 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:09.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 9242 9226 1.0296 0.835938 0.113538 0.121281 2024-04-25T09:38:09.888 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:10.023 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:10.031+0000 7fe4c739d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:10.029 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:10.040+0000 7fe4c739d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:10.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 9353 9337 1.02731 0.867188 0.230785 0.121526 2024-04-25T09:38:11.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 9484 9468 1.02725 1.02344 0.2021 0.121574 2024-04-25T09:38:12.225 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:12.358 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:12.367+0000 7f2a3f624640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:12.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:12.373+0000 7f2a3f624640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:12.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 9606 9590 1.02624 0.953125 0.144088 0.121636 2024-04-25T09:38:13.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 9719 9703 1.0243 0.882812 0.148388 0.121896 2024-04-25T09:38:13.648 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:13.648 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:13.648 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:13.813 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:13.816+0000 7f97f6464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:13.817 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:13.828+0000 7f97f6464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:14.046 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:14.047 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:14.063 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-04-25T09:38:13.359909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":78717472,"num_objects":1195,"num_object_clones":0,"num_object_copies":3585,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9674,"num_write_kb":78190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9618,"ondisk_log_size":9618,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":523812,"kb_used_data":116676,"kb_used_omap":0,"kb_used_meta":407104,"kb_avail":376963548,"statfs":{"total":386547056640,"available":386010673152,"internally_reserved":0,"allocated":119476224,"data_stored":236124508,"data_compressed":12138687,"data_compressed_allocated":116826112,"data_compressed_original":235126784,"omap_allocated":0,"internal_metadata":416874496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15622144,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1907,"num_write_kb":15256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002378"},"pg_stats":[{"pgid":"8.7","version":"76'703","reported_seq":727,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:12.014221+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:38:12.014221+0000","last_peered":"2024-04-25T09:38:12.014221+0000","last_clean":"2024-04-25T09:38:12.014221+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:38:12.014221+0000","last_undegraded":"2024-04-25T09:38:12.014221+0000","last_fullsized":"2024-04-25T09:38:12.014221+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'567","reported_seq":591,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:12.108757+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:38:12.108757+0000","last_peered":"2024-04-25T09:38:12.108757+0000","last_clean":"2024-04-25T09:38:12.108757+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:38:12.108757+0000","last_undegraded":"2024-04-25T09:38:12.108757+0000","last_fullsized":"2024-04-25T09:38:12.108757+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'543","reported_seq":567,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:10.884492+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:38:10.884492+0000","last_peered":"2024-04-25T09:38:10.884492+0000","last_clean":"2024-04-25T09:38:10.884492+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:38:10.884492+0000","last_undegraded":"2024-04-25T09:38:10.884492+0000","last_fullsized":"2024-04-25T09:38:10.884492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'615","reported_seq":641,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:11.248053+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:38:11.248053+0000","last_peered":"2024-04-25T09:38:11.248053+0000","last_clean":"2024-04-25T09:38:11.248053+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:38:11.248053+0000","last_undegraded":"2024-04-25T09:38:11.248053+0000","last_fullsized":"2024-04-25T09:38:11.248053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'487","reported_seq":511,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:10.223914+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:38:10.223914+0000","last_peered":"2024-04-25T09:38:10.223914+0000","last_clean":"2024-04-25T09:38:10.223914+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:38:10.223914+0000","last_undegraded":"2024-04-25T09:38:10.223914+0000","last_fullsized":"2024-04-25T09:38:10.223914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'567","reported_seq":593,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:11.029065+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:38:11.029065+0000","last_peered":"2024-04-25T09:38:11.029065+0000","last_clean":"2024-04-25T09:38:11.029065+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:38:11.029065+0000","last_undegraded":"2024-04-25T09:38:11.029065+0000","last_fullsized":"2024-04-25T09:38:11.029065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'721","reported_seq":745,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:12.475078+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:38:12.475078+0000","last_peered":"2024-04-25T09:38:12.475078+0000","last_clean":"2024-04-25T09:38:12.475078+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:38:12.475078+0000","last_undegraded":"2024-04-25T09:38:12.475078+0000","last_fullsized":"2024-04-25T09:38:12.475078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5914624,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":722,"num_write_kb":5776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'607","reported_seq":631,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:10.460620+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:38:10.460620+0000","last_peered":"2024-04-25T09:38:10.460620+0000","last_clean":"2024-04-25T09:38:10.460620+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:38:10.460620+0000","last_undegraded":"2024-04-25T09:38:10.460620+0000","last_fullsized":"2024-04-25T09:38:10.460620+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'607","reported_seq":633,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:10.141876+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:38:10.141876+0000","last_peered":"2024-04-25T09:38:10.141876+0000","last_clean":"2024-04-25T09:38:10.141876+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:38:10.141876+0000","last_undegraded":"2024-04-25T09:38:10.141876+0000","last_fullsized":"2024-04-25T09:38:10.141876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.475691+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:22.475691+0000","last_peered":"2024-04-25T09:37:22.475691+0000","last_clean":"2024-04-25T09:37:22.475691+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:22.475691+0000","last_undegraded":"2024-04-25T09:37:22.475691+0000","last_fullsized":"2024-04-25T09:37:22.475691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'671","reported_seq":695,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:11.787922+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:38:11.787922+0000","last_peered":"2024-04-25T09:38:11.787922+0000","last_clean":"2024-04-25T09:38:11.787922+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:38:11.787922+0000","last_undegraded":"2024-04-25T09:38:11.787922+0000","last_fullsized":"2024-04-25T09:38:11.787922+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'598","reported_seq":624,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:11.477803+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:38:11.477803+0000","last_peered":"2024-04-25T09:38:11.477803+0000","last_clean":"2024-04-25T09:38:11.477803+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:38:11.477803+0000","last_undegraded":"2024-04-25T09:38:11.477803+0000","last_fullsized":"2024-04-25T09:38:11.477803+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4907008,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":4792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.465006+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:22.465006+0000","last_peered":"2024-04-25T09:37:22.465006+0000","last_clean":"2024-04-25T09:37:22.465006+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:22.465006+0000","last_undegraded":"2024-04-25T09:37:22.465006+0000","last_fullsized":"2024-04-25T09:37:22.465006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'583","reported_seq":607,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:11.436072+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:38:11.436072+0000","last_peered":"2024-04-25T09:38:11.436072+0000","last_clean":"2024-04-25T09:38:11.436072+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:38:11.436072+0000","last_undegraded":"2024-04-25T09:38:11.436072+0000","last_fullsized":"2024-04-25T09:38:11.436072+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'503","reported_seq":529,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:10.259882+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:38:10.259882+0000","last_peered":"2024-04-25T09:38:10.259882+0000","last_clean":"2024-04-25T09:38:10.259882+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:38:10.259882+0000","last_undegraded":"2024-04-25T09:38:10.259882+0000","last_fullsized":"2024-04-25T09:38:10.259882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'551","reported_seq":575,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:11.911802+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:38:11.911802+0000","last_peered":"2024-04-25T09:38:11.911802+0000","last_clean":"2024-04-25T09:38:11.911802+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:38:11.911802+0000","last_undegraded":"2024-04-25T09:38:11.911802+0000","last_fullsized":"2024-04-25T09:38:11.911802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'615","reported_seq":641,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:10.974043+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:38:10.974043+0000","last_peered":"2024-04-25T09:38:10.974043+0000","last_clean":"2024-04-25T09:38:10.974043+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:38:10.974043+0000","last_undegraded":"2024-04-25T09:38:10.974043+0000","last_fullsized":"2024-04-25T09:38:10.974043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'583","reported_seq":609,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:08.283403+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:38:08.283403+0000","last_peered":"2024-04-25T09:38:08.283403+0000","last_clean":"2024-04-25T09:38:08.283403+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:38:08.283403+0000","last_undegraded":"2024-04-25T09:38:08.283403+0000","last_fullsized":"2024-04-25T09:38:08.283403+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":78127104,"num_objects":1193,"num_object_clones":0,"num_object_copies":3579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9537,"num_write_kb":76296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117051392,"data_stored":234102784,"data_compressed":12084741,"data_compressed_allocated":117051392,"data_compressed_original":234102784,"omap_allocated":0,"internal_metadata":0},"log_size":9521,"ondisk_log_size":9521,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141200,"kb_used_data":29704,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94230640,"statfs":{"total":96636764160,"available":96492175360,"internally_reserved":0,"allocated":30416896,"data_stored":60243679,"data_compressed":3097048,"data_compressed_allocated":29749248,"data_compressed_original":59990016,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111652,"kb_used_data":22364,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94260188,"statfs":{"total":96636764160,"available":96522432512,"internally_reserved":0,"allocated":22900736,"data_stored":45211359,"data_compressed":2321265,"data_compressed_allocated":22233088,"data_compressed_original":44957696,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141024,"kb_used_data":33688,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94230816,"statfs":{"total":96636764160,"available":96492355584,"internally_reserved":0,"allocated":34496512,"data_stored":67935423,"data_compressed":3494618,"data_compressed_allocated":33849344,"data_compressed_original":67698688,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129936,"kb_used_data":30920,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94241904,"statfs":{"total":96636764160,"available":96503709696,"internally_reserved":0,"allocated":31662080,"data_stored":62734047,"data_compressed":3225756,"data_compressed_allocated":30994432,"data_compressed_original":62480384,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31031296,"data_stored":62062592,"data_compressed":3203826,"data_compressed_allocated":31031296,"data_compressed_original":62062592,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33976320,"data_stored":67952640,"data_compressed":3507731,"data_compressed_allocated":33976320,"data_compressed_original":67952640,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22282240,"data_stored":44564480,"data_compressed":2300604,"data_compressed_allocated":22282240,"data_compressed_original":44564480,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29761536,"data_stored":59523072,"data_compressed":3072580,"data_compressed_allocated":29761536,"data_compressed_original":59523072,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:14.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 9839 9823 1.02314 0.9375 0.191422 0.122031 2024-04-25T09:38:14.547 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:14.711 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:14.720+0000 7f4b3cc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:14.717 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:14.728+0000 7f4b3cc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:15.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 9960 9944 1.02211 0.945312 0.0509199 0.122155 2024-04-25T09:38:16.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 10081 10065 1.02112 0.945312 0.32462 0.122254 2024-04-25T09:38:16.989 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:17.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:17.114+0000 7fe2eef9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:17.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:17.122+0000 7fe2eef9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:17.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 10194 10178 1.01934 0.882812 0.0249055 0.122486 2024-04-25T09:38:18.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 10316 10300 1.0185 0.953125 0.193059 0.122589 2024-04-25T09:38:19.065 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:19.070 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:19.070 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:19.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:19.204+0000 7f2fee8ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:19.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:19.217+0000 7f2fee8ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:19.369 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:19.477 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:19.477 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:19.481 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:38:19.493700+0000 min lat: 0.0155076 max lat: 0.424869 avg lat: 0.122737 2024-04-25T09:38:19.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:38:19.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 16 10434 10418 1.01729 0.921875 0.168698 0.122737 2024-04-25T09:38:19.493 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-04-25T09:38:19.361237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":83583520,"num_objects":1270,"num_object_clones":0,"num_object_copies":3810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10268,"num_write_kb":82942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10212,"ondisk_log_size":10212,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":539280,"kb_used_data":123824,"kb_used_omap":0,"kb_used_meta":415424,"kb_avail":376948080,"statfs":{"total":386547056640,"available":385994833920,"internally_reserved":0,"allocated":126795776,"data_stored":250763612,"data_compressed":12894588,"data_compressed_allocated":124145664,"data_compressed_original":249765888,"omap_allocated":0,"internal_metadata":425394176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11337728,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":11072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002562"},"pg_stats":[{"pgid":"8.7","version":"76'767","reported_seq":791,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:17.439677+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:38:17.439677+0000","last_peered":"2024-04-25T09:38:17.439677+0000","last_clean":"2024-04-25T09:38:17.439677+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:38:17.439677+0000","last_undegraded":"2024-04-25T09:38:17.439677+0000","last_fullsized":"2024-04-25T09:38:17.439677+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'599","reported_seq":623,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:16.480561+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:38:16.480561+0000","last_peered":"2024-04-25T09:38:16.480561+0000","last_clean":"2024-04-25T09:38:16.480561+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:38:16.480561+0000","last_undegraded":"2024-04-25T09:38:16.480561+0000","last_fullsized":"2024-04-25T09:38:16.480561+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'559","reported_seq":583,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:16.332322+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:38:16.332322+0000","last_peered":"2024-04-25T09:38:16.332322+0000","last_clean":"2024-04-25T09:38:16.332322+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:38:16.332322+0000","last_undegraded":"2024-04-25T09:38:16.332322+0000","last_fullsized":"2024-04-25T09:38:16.332322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'655","reported_seq":681,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:15.823475+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:38:15.823475+0000","last_peered":"2024-04-25T09:38:15.823475+0000","last_clean":"2024-04-25T09:38:15.823475+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:38:15.823475+0000","last_undegraded":"2024-04-25T09:38:15.823475+0000","last_fullsized":"2024-04-25T09:38:15.823475+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'511","reported_seq":535,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:14.945902+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:38:14.945902+0000","last_peered":"2024-04-25T09:38:14.945902+0000","last_clean":"2024-04-25T09:38:14.945902+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:38:14.945902+0000","last_undegraded":"2024-04-25T09:38:14.945902+0000","last_fullsized":"2024-04-25T09:38:14.945902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'607","reported_seq":633,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:16.017337+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:38:16.017337+0000","last_peered":"2024-04-25T09:38:16.017337+0000","last_clean":"2024-04-25T09:38:16.017337+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:38:16.017337+0000","last_undegraded":"2024-04-25T09:38:16.017337+0000","last_fullsized":"2024-04-25T09:38:16.017337+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'783","reported_seq":807,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:17.077929+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:38:17.077929+0000","last_peered":"2024-04-25T09:38:17.077929+0000","last_clean":"2024-04-25T09:38:17.077929+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:38:17.077929+0000","last_undegraded":"2024-04-25T09:38:17.077929+0000","last_fullsized":"2024-04-25T09:38:17.077929+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'647","reported_seq":671,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:16.427696+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:38:16.427696+0000","last_peered":"2024-04-25T09:38:16.427696+0000","last_clean":"2024-04-25T09:38:16.427696+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:38:16.427696+0000","last_undegraded":"2024-04-25T09:38:16.427696+0000","last_fullsized":"2024-04-25T09:38:16.427696+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'647","reported_seq":673,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:15.410037+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:38:15.410037+0000","last_peered":"2024-04-25T09:38:15.410037+0000","last_clean":"2024-04-25T09:38:15.410037+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:38:15.410037+0000","last_undegraded":"2024-04-25T09:38:15.410037+0000","last_fullsized":"2024-04-25T09:38:15.410037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.475691+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:22.475691+0000","last_peered":"2024-04-25T09:37:22.475691+0000","last_clean":"2024-04-25T09:37:22.475691+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:22.475691+0000","last_undegraded":"2024-04-25T09:37:22.475691+0000","last_fullsized":"2024-04-25T09:37:22.475691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'717","reported_seq":741,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:17.461603+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:38:17.461603+0000","last_peered":"2024-04-25T09:38:17.461603+0000","last_clean":"2024-04-25T09:38:17.461603+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:38:17.461603+0000","last_undegraded":"2024-04-25T09:38:17.461603+0000","last_fullsized":"2024-04-25T09:38:17.461603+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5881856,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":5744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'631","reported_seq":657,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:13.834532+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:38:13.834532+0000","last_peered":"2024-04-25T09:38:13.834532+0000","last_clean":"2024-04-25T09:38:13.834532+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:38:13.834532+0000","last_undegraded":"2024-04-25T09:38:13.834532+0000","last_fullsized":"2024-04-25T09:38:13.834532+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.465006+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:22.465006+0000","last_peered":"2024-04-25T09:37:22.465006+0000","last_clean":"2024-04-25T09:37:22.465006+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:22.465006+0000","last_undegraded":"2024-04-25T09:37:22.465006+0000","last_fullsized":"2024-04-25T09:37:22.465006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'607","reported_seq":631,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:15.064517+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:38:15.064517+0000","last_peered":"2024-04-25T09:38:15.064517+0000","last_clean":"2024-04-25T09:38:15.064517+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:38:15.064517+0000","last_undegraded":"2024-04-25T09:38:15.064517+0000","last_fullsized":"2024-04-25T09:38:15.064517+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'535","reported_seq":561,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:15.701259+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:38:15.701259+0000","last_peered":"2024-04-25T09:38:15.701259+0000","last_clean":"2024-04-25T09:38:15.701259+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:38:15.701259+0000","last_undegraded":"2024-04-25T09:38:15.701259+0000","last_fullsized":"2024-04-25T09:38:15.701259+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'592","reported_seq":616,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:17.191370+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:38:17.191370+0000","last_peered":"2024-04-25T09:38:17.191370+0000","last_clean":"2024-04-25T09:38:17.191370+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:38:17.191370+0000","last_undegraded":"2024-04-25T09:38:17.191370+0000","last_fullsized":"2024-04-25T09:38:17.191370+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4857856,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":4744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'643","reported_seq":669,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:16.478618+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:38:16.478618+0000","last_peered":"2024-04-25T09:38:16.478618+0000","last_clean":"2024-04-25T09:38:16.478618+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:38:16.478618+0000","last_undegraded":"2024-04-25T09:38:16.478618+0000","last_fullsized":"2024-04-25T09:38:16.478618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5275648,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":644,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'615","reported_seq":641,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:14.312940+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:38:14.312940+0000","last_peered":"2024-04-25T09:38:14.312940+0000","last_clean":"2024-04-25T09:38:14.312940+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:38:14.312940+0000","last_undegraded":"2024-04-25T09:38:14.312940+0000","last_fullsized":"2024-04-25T09:38:14.312940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":82993152,"num_objects":1268,"num_object_clones":0,"num_object_copies":3804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10131,"num_write_kb":81048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":124411904,"data_stored":248823808,"data_compressed":12844872,"data_compressed_allocated":124411904,"data_compressed_original":248823808,"omap_allocated":0,"internal_metadata":0},"log_size":10115,"ondisk_log_size":10115,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143188,"kb_used_data":31692,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94228652,"statfs":{"total":96636764160,"available":96490139648,"internally_reserved":0,"allocated":32452608,"data_stored":64315103,"data_compressed":3307279,"data_compressed_allocated":31784960,"data_compressed_original":64061440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117052,"kb_used_data":23604,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94254788,"statfs":{"total":96636764160,"available":96516902912,"internally_reserved":0,"allocated":24170496,"data_stored":47750879,"data_compressed":2452395,"data_compressed_allocated":23502848,"data_compressed_original":47497216,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143120,"kb_used_data":35784,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94228720,"statfs":{"total":96636764160,"available":96490209280,"internally_reserved":0,"allocated":36642816,"data_stored":72228031,"data_compressed":3716270,"data_compressed_allocated":35995648,"data_compressed_original":71991296,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706298,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135920,"kb_used_data":32744,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94235920,"statfs":{"total":96636764160,"available":96497582080,"internally_reserved":0,"allocated":33529856,"data_stored":66469599,"data_compressed":3418644,"data_compressed_allocated":32862208,"data_compressed_original":66215936,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32915456,"data_stored":65830912,"data_compressed":3398406,"data_compressed_allocated":32915456,"data_compressed_original":65830912,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36093952,"data_stored":72187904,"data_compressed":3726422,"data_compressed_allocated":36093952,"data_compressed_original":72187904,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23588864,"data_stored":47177728,"data_compressed":2435541,"data_compressed_allocated":23588864,"data_compressed_original":47177728,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31813632,"data_stored":63627264,"data_compressed":3284503,"data_compressed_allocated":31813632,"data_compressed_original":63627264,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:19.526 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:19.534+0000 7fd263e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:19.530 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:19.541+0000 7fd263e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:20.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 10550 10534 1.01592 0.90625 0.18406 0.122888 2024-04-25T09:38:21.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 10673 10657 1.01525 0.960938 0.0858963 0.12303 2024-04-25T09:38:21.696 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:21.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:21.828+0000 7fd54d02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:21.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:21.838+0000 7fd54d02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:22.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 15 10802 10787 1.01525 1.01562 0.0216567 0.123003 2024-04-25T09:38:23.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 10932 10916 1.01516 1.00781 0.158084 0.122997 2024-04-25T09:38:23.990 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:24.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:24.118+0000 7fc43b15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:24.114 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:24.125+0000 7fc43b15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:24.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 11060 11044 1.01498 1 0.116447 0.123054 2024-04-25T09:38:24.496 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:24.496 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:24.496 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:24.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:24.634+0000 7f0ccd6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:24.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:24.643+0000 7f0ccd6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:24.868 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:24.868 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:24.882 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-04-25T09:38:23.362026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88293920,"num_objects":1341,"num_object_clones":0,"num_object_copies":4023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10843,"num_write_kb":87542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10787,"ondisk_log_size":10787,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":538060,"kb_used_data":130924,"kb_used_omap":0,"kb_used_meta":407104,"kb_avail":376949300,"statfs":{"total":386547056640,"available":385996083200,"internally_reserved":0,"allocated":134066176,"data_stored":265304412,"data_compressed":13645413,"data_compressed_allocated":131416064,"data_compressed_original":264306688,"omap_allocated":0,"internal_metadata":416874496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14630912,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1786,"num_write_kb":14288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002537"},"pg_stats":[{"pgid":"8.7","version":"76'823","reported_seq":847,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:21.913468+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:38:21.913468+0000","last_peered":"2024-04-25T09:38:21.913468+0000","last_clean":"2024-04-25T09:38:21.913468+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:38:21.913468+0000","last_undegraded":"2024-04-25T09:38:21.913468+0000","last_fullsized":"2024-04-25T09:38:21.913468+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'631","reported_seq":655,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:22.052281+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:38:22.052281+0000","last_peered":"2024-04-25T09:38:22.052281+0000","last_clean":"2024-04-25T09:38:22.052281+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:38:22.052281+0000","last_undegraded":"2024-04-25T09:38:22.052281+0000","last_fullsized":"2024-04-25T09:38:22.052281+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'599","reported_seq":623,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:21.352194+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:38:21.352194+0000","last_peered":"2024-04-25T09:38:21.352194+0000","last_clean":"2024-04-25T09:38:21.352194+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:38:21.352194+0000","last_undegraded":"2024-04-25T09:38:21.352194+0000","last_fullsized":"2024-04-25T09:38:21.352194+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'719","reported_seq":745,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:21.384240+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:38:21.384240+0000","last_peered":"2024-04-25T09:38:21.384240+0000","last_clean":"2024-04-25T09:38:21.384240+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:38:21.384240+0000","last_undegraded":"2024-04-25T09:38:21.384240+0000","last_fullsized":"2024-04-25T09:38:21.384240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'559","reported_seq":583,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:21.233729+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:38:21.233729+0000","last_peered":"2024-04-25T09:38:21.233729+0000","last_clean":"2024-04-25T09:38:21.233729+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:38:21.233729+0000","last_undegraded":"2024-04-25T09:38:21.233729+0000","last_fullsized":"2024-04-25T09:38:21.233729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'629","reported_seq":655,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:21.458350+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:38:21.458350+0000","last_peered":"2024-04-25T09:38:21.458350+0000","last_clean":"2024-04-25T09:38:21.458350+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:38:21.458350+0000","last_undegraded":"2024-04-25T09:38:21.458350+0000","last_fullsized":"2024-04-25T09:38:21.458350+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160960,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":5040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'815","reported_seq":839,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:22.025997+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:38:22.025997+0000","last_peered":"2024-04-25T09:38:22.025997+0000","last_clean":"2024-04-25T09:38:22.025997+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:38:22.025997+0000","last_undegraded":"2024-04-25T09:38:22.025997+0000","last_fullsized":"2024-04-25T09:38:22.025997+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'679","reported_seq":703,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:21.093214+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:38:21.093214+0000","last_peered":"2024-04-25T09:38:21.093214+0000","last_clean":"2024-04-25T09:38:21.093214+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:38:21.093214+0000","last_undegraded":"2024-04-25T09:38:21.093214+0000","last_fullsized":"2024-04-25T09:38:21.093214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'679","reported_seq":705,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:20.742349+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:38:20.742349+0000","last_peered":"2024-04-25T09:38:20.742349+0000","last_clean":"2024-04-25T09:38:20.742349+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:38:20.742349+0000","last_undegraded":"2024-04-25T09:38:20.742349+0000","last_fullsized":"2024-04-25T09:38:20.742349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.475691+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:37:22.475691+0000","last_peered":"2024-04-25T09:37:22.475691+0000","last_clean":"2024-04-25T09:37:22.475691+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:37:22.475691+0000","last_undegraded":"2024-04-25T09:37:22.475691+0000","last_fullsized":"2024-04-25T09:37:22.475691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'775","reported_seq":799,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:22.266753+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:38:22.266753+0000","last_peered":"2024-04-25T09:38:22.266753+0000","last_clean":"2024-04-25T09:38:22.266753+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:38:22.266753+0000","last_undegraded":"2024-04-25T09:38:22.266753+0000","last_fullsized":"2024-04-25T09:38:22.266753+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'671","reported_seq":697,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:20.524740+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:38:20.524740+0000","last_peered":"2024-04-25T09:38:20.524740+0000","last_clean":"2024-04-25T09:38:20.524740+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:38:20.524740+0000","last_undegraded":"2024-04-25T09:38:20.524740+0000","last_fullsized":"2024-04-25T09:38:20.524740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.465006+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:37:22.465006+0000","last_peered":"2024-04-25T09:37:22.465006+0000","last_clean":"2024-04-25T09:37:22.465006+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:37:22.465006+0000","last_undegraded":"2024-04-25T09:37:22.465006+0000","last_fullsized":"2024-04-25T09:37:22.465006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'663","reported_seq":687,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:20.348547+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:38:20.348547+0000","last_peered":"2024-04-25T09:38:20.348547+0000","last_clean":"2024-04-25T09:38:20.348547+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:38:20.348547+0000","last_undegraded":"2024-04-25T09:38:20.348547+0000","last_fullsized":"2024-04-25T09:38:20.348547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'555","reported_seq":581,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:21.491760+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:38:21.491760+0000","last_peered":"2024-04-25T09:38:21.491760+0000","last_clean":"2024-04-25T09:38:21.491760+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:38:21.491760+0000","last_undegraded":"2024-04-25T09:38:21.491760+0000","last_fullsized":"2024-04-25T09:38:21.491760+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4554752,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":4448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'607","reported_seq":631,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:17.812102+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:38:17.812102+0000","last_peered":"2024-04-25T09:38:17.812102+0000","last_clean":"2024-04-25T09:38:17.812102+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:38:17.812102+0000","last_undegraded":"2024-04-25T09:38:17.812102+0000","last_fullsized":"2024-04-25T09:38:17.812102+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'663","reported_seq":689,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:20.307747+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:38:20.307747+0000","last_peered":"2024-04-25T09:38:20.307747+0000","last_clean":"2024-04-25T09:38:20.307747+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:38:20.307747+0000","last_undegraded":"2024-04-25T09:38:20.307747+0000","last_fullsized":"2024-04-25T09:38:20.307747+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'623","reported_seq":649,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:19.259780+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:38:19.259780+0000","last_peered":"2024-04-25T09:38:19.259780+0000","last_clean":"2024-04-25T09:38:19.259780+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:38:19.259780+0000","last_undegraded":"2024-04-25T09:38:19.259780+0000","last_fullsized":"2024-04-25T09:38:19.259780+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":87703552,"num_objects":1339,"num_object_clones":0,"num_object_copies":4017,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10706,"num_write_kb":85648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131645440,"data_stored":263290880,"data_compressed":13591890,"data_compressed_allocated":131645440,"data_compressed_original":263290880,"omap_allocated":0,"internal_metadata":0},"log_size":10690,"ondisk_log_size":10690,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132568,"kb_used_data":33552,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94239272,"statfs":{"total":96636764160,"available":96501014528,"internally_reserved":0,"allocated":34357248,"data_stored":68124383,"data_compressed":3503974,"data_compressed_allocated":33689600,"data_compressed_original":67870720,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673599,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118388,"kb_used_data":24940,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94253452,"statfs":{"total":96636764160,"available":96515534848,"internally_reserved":0,"allocated":25538560,"data_stored":50487007,"data_compressed":2593677,"data_compressed_allocated":24870912,"data_compressed_original":50233344,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149436,"kb_used_data":37940,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94222404,"statfs":{"total":96636764160,"available":96483741696,"internally_reserved":0,"allocated":38850560,"data_stored":76643519,"data_compressed":3944267,"data_compressed_allocated":38203392,"data_compressed_original":76406784,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137668,"kb_used_data":34492,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94234172,"statfs":{"total":96636764160,"available":96495792128,"internally_reserved":0,"allocated":35319808,"data_stored":70049503,"data_compressed":3603495,"data_compressed_allocated":34652160,"data_compressed_original":69795840,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34709504,"data_stored":69419008,"data_compressed":3583680,"data_compressed_allocated":34709504,"data_compressed_original":69419008,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":38297600,"data_stored":76595200,"data_compressed":3953996,"data_compressed_allocated":38297600,"data_compressed_original":76595200,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24952832,"data_stored":49905664,"data_compressed":2576400,"data_compressed_allocated":24952832,"data_compressed_original":49905664,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33685504,"data_stored":67371008,"data_compressed":3477814,"data_compressed_allocated":33685504,"data_compressed_original":67371008,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:25.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 11164 11148 1.01263 0.8125 0.192456 0.123311 2024-04-25T09:38:26.316 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:26.434 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:26.442+0000 7f87ad79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:26.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:26.449+0000 7f87ad79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:26.482 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 11286 11270 1.01194 0.953125 0.232293 0.123357 2024-04-25T09:38:27.483 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 11400 11384 1.01056 0.890625 0.148813 0.123579 2024-04-25T09:38:28.483 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 11516 11500 1.00939 0.90625 0.0336487 0.123698 2024-04-25T09:38:28.654 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:28.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:28.796+0000 7f14be39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:28.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:28.803+0000 7f14be39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:29.483 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 16 11626 11610 1.00772 0.859375 0.112936 0.12388 2024-04-25T09:38:29.884 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:29.884 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:29.885 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:38:29.885 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:38:29.993 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:29.999+0000 7fe3afc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:29.997 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:30.008+0000 7fe3afc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:30.013 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:30.014 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:30.014 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:30.014 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:30.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:30.016 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:30.016 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:38:30.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:30.128+0000 7fd16a86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:30.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:30.137+0000 7fd16a86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:30.143 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:30.143 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:30.143 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:30.143 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:30.143 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:30.144 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:30.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:30.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:30.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:30.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:30.144 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:30.144 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:30.146 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:30.147 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:30.147 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:38:30.255 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:30.261+0000 7fb1f3aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:30.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:30.270+0000 7fb1f3aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:30.274 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:30.274 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:30.274 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:30.274 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:30.274 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:30.275 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:30.275 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:30.275 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:30.275 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:30.275 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:30.275 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:30.275 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:30.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:30.277 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:30.277 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:38:30.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:30.392+0000 7f1b67f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:30.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:30.401+0000 7f1b67f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:38:30.407 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:38:30.408 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:38:30.408 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:38:30.409 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:38:30.410 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:38:30.483 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1977 2024-04-25T09:38:30.483 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 11626 2024-04-25T09:38:30.483 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.00699 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.0909806 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.21875 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.726562 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 128 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 11.6455 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 156 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 93 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.123988 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.0608321 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.424869 2024-04-25T09:38:30.484 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0155076 2024-04-25T09:38:30.518 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:38:30.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:31.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:31.088+0000 7fd07802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:31.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:31.096+0000 7fd07802d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:33.516 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:33.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:33.672+0000 7f6f2651d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:33.669 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:33.680+0000 7f6f2651d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:35.411 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:35.411 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:38:35.549 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:35.546+0000 7f8507e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:35.553 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:35.564+0000 7f8507e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:35.980 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:36.117 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:36.123+0000 7fa7b5f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:36.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:36.133+0000 7fa7b5f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:36.377 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:38:36.394 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:38:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:36.535+0000 7fd32166d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:36.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:36.548+0000 7fd32166d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:37.387 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:38:37.406 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:38:37.561 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:37.562+0000 7f9e1135d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:37.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:37.577+0000 7f9e1135d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:38.392 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:38:38.412 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:38:38.564 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:38.574 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:38.575+0000 7f6c8175d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:38.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:38.589+0000 7f6c8175d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:38.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:38.728+0000 7f17d779d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:38.728 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:38.738+0000 7f17d779d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:39.403 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:38:39.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:38:39.421 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:39.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:39.584+0000 7f851d6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:39.585 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:39.595+0000 7f851d6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:39.856 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:39.856 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:39.873 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-04-25T09:38:39.414079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38814264,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":12634,"num_write_kb":94903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12581,"ondisk_log_size":12581,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":450072,"kb_used_data":59576,"kb_used_omap":0,"kb_used_meta":390464,"kb_avail":377037288,"statfs":{"total":386547056640,"available":386086182912,"internally_reserved":0,"allocated":61005824,"data_stored":119159204,"data_compressed":6102420,"data_compressed_allocated":58343424,"data_compressed_original":118161408,"omap_allocated":0,"internal_metadata":399835136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-45547520,"num_objects":-695,"num_object_clones":0,"num_object_copies":-2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.049193"},"pg_stats":[{"pgid":"8.7","version":"76'982","reported_seq":1006,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.332284+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:38:37.332284+0000","last_peered":"2024-04-25T09:38:37.332284+0000","last_clean":"2024-04-25T09:38:37.332284+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:38:37.332284+0000","last_undegraded":"2024-04-25T09:38:37.332284+0000","last_fullsized":"2024-04-25T09:38:37.332284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":983,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'731","reported_seq":755,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.187810+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:38:37.187810+0000","last_peered":"2024-04-25T09:38:37.187810+0000","last_clean":"2024-04-25T09:38:37.187810+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:38:37.187810+0000","last_undegraded":"2024-04-25T09:38:37.187810+0000","last_fullsized":"2024-04-25T09:38:37.187810+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'687","reported_seq":711,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.324786+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:38:36.324786+0000","last_peered":"2024-04-25T09:38:36.324786+0000","last_clean":"2024-04-25T09:38:36.324786+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:38:36.324786+0000","last_undegraded":"2024-04-25T09:38:36.324786+0000","last_fullsized":"2024-04-25T09:38:36.324786+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'807","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.419787+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:38:36.419787+0000","last_peered":"2024-04-25T09:38:36.419787+0000","last_clean":"2024-04-25T09:38:36.419787+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:38:36.419787+0000","last_undegraded":"2024-04-25T09:38:36.419787+0000","last_fullsized":"2024-04-25T09:38:36.419787+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'671","reported_seq":695,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.185182+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:38:36.185182+0000","last_peered":"2024-04-25T09:38:36.185182+0000","last_clean":"2024-04-25T09:38:36.185182+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:38:36.185182+0000","last_undegraded":"2024-04-25T09:38:36.185182+0000","last_fullsized":"2024-04-25T09:38:36.185182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'717","reported_seq":743,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.360355+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:38:36.360355+0000","last_peered":"2024-04-25T09:38:36.360355+0000","last_clean":"2024-04-25T09:38:36.360355+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:38:36.360355+0000","last_undegraded":"2024-04-25T09:38:36.360355+0000","last_fullsized":"2024-04-25T09:38:36.360355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'939","reported_seq":963,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.345535+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:38:37.345535+0000","last_peered":"2024-04-25T09:38:37.345535+0000","last_clean":"2024-04-25T09:38:37.345535+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:38:37.345535+0000","last_undegraded":"2024-04-25T09:38:37.345535+0000","last_fullsized":"2024-04-25T09:38:37.345535+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":940,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'830","reported_seq":854,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.419837+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:38:36.419837+0000","last_peered":"2024-04-25T09:38:36.419837+0000","last_clean":"2024-04-25T09:38:36.419837+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:38:36.419837+0000","last_undegraded":"2024-04-25T09:38:36.419837+0000","last_fullsized":"2024-04-25T09:38:36.419837+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'773","reported_seq":799,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.389088+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:38:36.389088+0000","last_peered":"2024-04-25T09:38:36.389088+0000","last_clean":"2024-04-25T09:38:36.389088+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:38:36.389088+0000","last_undegraded":"2024-04-25T09:38:36.389088+0000","last_fullsized":"2024-04-25T09:38:36.389088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.515939+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:36.515939+0000","last_peered":"2024-04-25T09:38:36.515939+0000","last_clean":"2024-04-25T09:38:36.515939+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:36.515939+0000","last_undegraded":"2024-04-25T09:38:36.515939+0000","last_fullsized":"2024-04-25T09:38:36.515939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'850","reported_seq":874,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.299240+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:38:37.299240+0000","last_peered":"2024-04-25T09:38:37.299240+0000","last_clean":"2024-04-25T09:38:37.299240+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:38:37.299240+0000","last_undegraded":"2024-04-25T09:38:37.299240+0000","last_fullsized":"2024-04-25T09:38:37.299240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":851,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'811","reported_seq":837,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.067495+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:38:36.067495+0000","last_peered":"2024-04-25T09:38:36.067495+0000","last_clean":"2024-04-25T09:38:36.067495+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:38:36.067495+0000","last_undegraded":"2024-04-25T09:38:36.067495+0000","last_fullsized":"2024-04-25T09:38:36.067495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3555328,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.500768+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:36.500768+0000","last_peered":"2024-04-25T09:38:36.500768+0000","last_clean":"2024-04-25T09:38:36.500768+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:36.500768+0000","last_undegraded":"2024-04-25T09:38:36.500768+0000","last_fullsized":"2024-04-25T09:38:36.500768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'769","reported_seq":795,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.494758+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:38:36.494758+0000","last_peered":"2024-04-25T09:38:36.494758+0000","last_clean":"2024-04-25T09:38:36.494758+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:38:36.494758+0000","last_undegraded":"2024-04-25T09:38:36.494758+0000","last_fullsized":"2024-04-25T09:38:36.494758+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'651","reported_seq":677,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.446406+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:38:36.446406+0000","last_peered":"2024-04-25T09:38:36.446406+0000","last_clean":"2024-04-25T09:38:36.446406+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:38:36.446406+0000","last_undegraded":"2024-04-25T09:38:36.446406+0000","last_fullsized":"2024-04-25T09:38:36.446406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'730","reported_seq":754,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.056308+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:38:37.056308+0000","last_peered":"2024-04-25T09:38:37.056308+0000","last_clean":"2024-04-25T09:38:37.056308+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:38:37.056308+0000","last_undegraded":"2024-04-25T09:38:37.056308+0000","last_fullsized":"2024-04-25T09:38:37.056308+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'775","reported_seq":801,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.224886+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:38:36.224886+0000","last_peered":"2024-04-25T09:38:36.224886+0000","last_clean":"2024-04-25T09:38:36.224886+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:38:36.224886+0000","last_undegraded":"2024-04-25T09:38:36.224886+0000","last_fullsized":"2024-04-25T09:38:36.224886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'761","reported_seq":788,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.333139+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:38:36.333139+0000","last_peered":"2024-04-25T09:38:36.333139+0000","last_clean":"2024-04-25T09:38:36.333139+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:38:36.333139+0000","last_undegraded":"2024-04-25T09:38:36.333139+0000","last_fullsized":"2024-04-25T09:38:36.333139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621464,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":762,"num_write_kb":5697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":38223896,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12497,"num_write_kb":93009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55873536,"data_stored":111722568,"data_compressed":5768871,"data_compressed_allocated":55861248,"data_compressed_original":111722496,"omap_allocated":0,"internal_metadata":0},"log_size":12484,"ondisk_log_size":12484,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116060,"kb_used_data":12884,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94255780,"statfs":{"total":96636764160,"available":96517918720,"internally_reserved":0,"allocated":13193216,"data_stored":25796319,"data_compressed":1319271,"data_compressed_allocated":12525568,"data_compressed_original":25542656,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91496,"kb_used_data":10528,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94280344,"statfs":{"total":96636764160,"available":96543072256,"internally_reserved":0,"allocated":10780672,"data_stored":20963063,"data_compressed":1069700,"data_compressed_allocated":10108928,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117900,"kb_used_data":18884,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94253940,"statfs":{"total":96636764160,"available":96516034560,"internally_reserved":0,"allocated":19337216,"data_stored":37608663,"data_compressed":1929725,"data_compressed_allocated":18685952,"data_compressed_original":37371904,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124616,"kb_used_data":17280,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94247224,"statfs":{"total":96636764160,"available":96509157376,"internally_reserved":0,"allocated":17694720,"data_stored":34791159,"data_compressed":1783724,"data_compressed_allocated":17022976,"data_compressed_original":34537472,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":32587800,"data_compressed":1682693,"data_compressed_allocated":16293888,"data_compressed_original":32587776,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18231296,"data_stored":36454424,"data_compressed":1882349,"data_compressed_allocated":18227200,"data_compressed_original":36454400,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":18432024,"data_compressed":951749,"data_compressed_allocated":9216000,"data_compressed_original":18432000,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12124160,"data_stored":24248320,"data_compressed":1252080,"data_compressed_allocated":12124160,"data_compressed_original":24248320,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:39.874 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:40.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:40.012+0000 7f04d426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:40.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:40.023+0000 7f04d426d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:40.237 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:40.238 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:40.254 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-04-25T09:38:39.414079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38814264,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":12634,"num_write_kb":94903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12581,"ondisk_log_size":12581,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":450072,"kb_used_data":59576,"kb_used_omap":0,"kb_used_meta":390464,"kb_avail":377037288,"statfs":{"total":386547056640,"available":386086182912,"internally_reserved":0,"allocated":61005824,"data_stored":119159204,"data_compressed":6102420,"data_compressed_allocated":58343424,"data_compressed_original":118161408,"omap_allocated":0,"internal_metadata":399835136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-45547520,"num_objects":-695,"num_object_clones":0,"num_object_copies":-2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.049193"},"pg_stats":[{"pgid":"8.7","version":"76'982","reported_seq":1006,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.332284+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:38:37.332284+0000","last_peered":"2024-04-25T09:38:37.332284+0000","last_clean":"2024-04-25T09:38:37.332284+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:38:37.332284+0000","last_undegraded":"2024-04-25T09:38:37.332284+0000","last_fullsized":"2024-04-25T09:38:37.332284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":983,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'731","reported_seq":755,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.187810+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:38:37.187810+0000","last_peered":"2024-04-25T09:38:37.187810+0000","last_clean":"2024-04-25T09:38:37.187810+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:38:37.187810+0000","last_undegraded":"2024-04-25T09:38:37.187810+0000","last_fullsized":"2024-04-25T09:38:37.187810+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'687","reported_seq":711,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.324786+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:38:36.324786+0000","last_peered":"2024-04-25T09:38:36.324786+0000","last_clean":"2024-04-25T09:38:36.324786+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:38:36.324786+0000","last_undegraded":"2024-04-25T09:38:36.324786+0000","last_fullsized":"2024-04-25T09:38:36.324786+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'807","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.419787+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:38:36.419787+0000","last_peered":"2024-04-25T09:38:36.419787+0000","last_clean":"2024-04-25T09:38:36.419787+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:38:36.419787+0000","last_undegraded":"2024-04-25T09:38:36.419787+0000","last_fullsized":"2024-04-25T09:38:36.419787+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'671","reported_seq":695,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.185182+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:38:36.185182+0000","last_peered":"2024-04-25T09:38:36.185182+0000","last_clean":"2024-04-25T09:38:36.185182+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:38:36.185182+0000","last_undegraded":"2024-04-25T09:38:36.185182+0000","last_fullsized":"2024-04-25T09:38:36.185182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'717","reported_seq":743,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.360355+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:38:36.360355+0000","last_peered":"2024-04-25T09:38:36.360355+0000","last_clean":"2024-04-25T09:38:36.360355+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:38:36.360355+0000","last_undegraded":"2024-04-25T09:38:36.360355+0000","last_fullsized":"2024-04-25T09:38:36.360355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'939","reported_seq":963,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.345535+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:38:37.345535+0000","last_peered":"2024-04-25T09:38:37.345535+0000","last_clean":"2024-04-25T09:38:37.345535+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:38:37.345535+0000","last_undegraded":"2024-04-25T09:38:37.345535+0000","last_fullsized":"2024-04-25T09:38:37.345535+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":940,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'830","reported_seq":854,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.419837+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:38:36.419837+0000","last_peered":"2024-04-25T09:38:36.419837+0000","last_clean":"2024-04-25T09:38:36.419837+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:38:36.419837+0000","last_undegraded":"2024-04-25T09:38:36.419837+0000","last_fullsized":"2024-04-25T09:38:36.419837+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'773","reported_seq":799,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.389088+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:38:36.389088+0000","last_peered":"2024-04-25T09:38:36.389088+0000","last_clean":"2024-04-25T09:38:36.389088+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:38:36.389088+0000","last_undegraded":"2024-04-25T09:38:36.389088+0000","last_fullsized":"2024-04-25T09:38:36.389088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.515939+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:36.515939+0000","last_peered":"2024-04-25T09:38:36.515939+0000","last_clean":"2024-04-25T09:38:36.515939+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:36.515939+0000","last_undegraded":"2024-04-25T09:38:36.515939+0000","last_fullsized":"2024-04-25T09:38:36.515939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'850","reported_seq":874,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.299240+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:38:37.299240+0000","last_peered":"2024-04-25T09:38:37.299240+0000","last_clean":"2024-04-25T09:38:37.299240+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:38:37.299240+0000","last_undegraded":"2024-04-25T09:38:37.299240+0000","last_fullsized":"2024-04-25T09:38:37.299240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":851,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'811","reported_seq":837,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.067495+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:38:36.067495+0000","last_peered":"2024-04-25T09:38:36.067495+0000","last_clean":"2024-04-25T09:38:36.067495+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:38:36.067495+0000","last_undegraded":"2024-04-25T09:38:36.067495+0000","last_fullsized":"2024-04-25T09:38:36.067495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3555328,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.500768+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:36.500768+0000","last_peered":"2024-04-25T09:38:36.500768+0000","last_clean":"2024-04-25T09:38:36.500768+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:36.500768+0000","last_undegraded":"2024-04-25T09:38:36.500768+0000","last_fullsized":"2024-04-25T09:38:36.500768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'769","reported_seq":795,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.494758+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:38:36.494758+0000","last_peered":"2024-04-25T09:38:36.494758+0000","last_clean":"2024-04-25T09:38:36.494758+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:38:36.494758+0000","last_undegraded":"2024-04-25T09:38:36.494758+0000","last_fullsized":"2024-04-25T09:38:36.494758+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'651","reported_seq":677,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.446406+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:38:36.446406+0000","last_peered":"2024-04-25T09:38:36.446406+0000","last_clean":"2024-04-25T09:38:36.446406+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:38:36.446406+0000","last_undegraded":"2024-04-25T09:38:36.446406+0000","last_fullsized":"2024-04-25T09:38:36.446406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'730","reported_seq":754,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.056308+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:38:37.056308+0000","last_peered":"2024-04-25T09:38:37.056308+0000","last_clean":"2024-04-25T09:38:37.056308+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:38:37.056308+0000","last_undegraded":"2024-04-25T09:38:37.056308+0000","last_fullsized":"2024-04-25T09:38:37.056308+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'775","reported_seq":801,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.224886+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:38:36.224886+0000","last_peered":"2024-04-25T09:38:36.224886+0000","last_clean":"2024-04-25T09:38:36.224886+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:38:36.224886+0000","last_undegraded":"2024-04-25T09:38:36.224886+0000","last_fullsized":"2024-04-25T09:38:36.224886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'761","reported_seq":788,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.333139+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:38:36.333139+0000","last_peered":"2024-04-25T09:38:36.333139+0000","last_clean":"2024-04-25T09:38:36.333139+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:38:36.333139+0000","last_undegraded":"2024-04-25T09:38:36.333139+0000","last_fullsized":"2024-04-25T09:38:36.333139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621464,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":762,"num_write_kb":5697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":38223896,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12497,"num_write_kb":93009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55873536,"data_stored":111722568,"data_compressed":5768871,"data_compressed_allocated":55861248,"data_compressed_original":111722496,"omap_allocated":0,"internal_metadata":0},"log_size":12484,"ondisk_log_size":12484,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116060,"kb_used_data":12884,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94255780,"statfs":{"total":96636764160,"available":96517918720,"internally_reserved":0,"allocated":13193216,"data_stored":25796319,"data_compressed":1319271,"data_compressed_allocated":12525568,"data_compressed_original":25542656,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91496,"kb_used_data":10528,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94280344,"statfs":{"total":96636764160,"available":96543072256,"internally_reserved":0,"allocated":10780672,"data_stored":20963063,"data_compressed":1069700,"data_compressed_allocated":10108928,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117900,"kb_used_data":18884,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94253940,"statfs":{"total":96636764160,"available":96516034560,"internally_reserved":0,"allocated":19337216,"data_stored":37608663,"data_compressed":1929725,"data_compressed_allocated":18685952,"data_compressed_original":37371904,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124616,"kb_used_data":17280,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94247224,"statfs":{"total":96636764160,"available":96509157376,"internally_reserved":0,"allocated":17694720,"data_stored":34791159,"data_compressed":1783724,"data_compressed_allocated":17022976,"data_compressed_original":34537472,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":32587800,"data_compressed":1682693,"data_compressed_allocated":16293888,"data_compressed_original":32587776,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18231296,"data_stored":36454424,"data_compressed":1882349,"data_compressed_allocated":18227200,"data_compressed_original":36454400,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":18432024,"data_compressed":951749,"data_compressed_allocated":9216000,"data_compressed_original":18432000,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12124160,"data_stored":24248320,"data_compressed":1252080,"data_compressed_allocated":12124160,"data_compressed_original":24248320,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:40.255 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:38:40.256 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:40.256 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:40.395 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:40.400+0000 7f4a1459d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:40.399 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:40.410+0000 7f4a1459d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:40.674 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:40.674 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:40.696 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-04-25T09:38:39.414079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38814264,"num_objects":587,"num_object_clones":0,"num_object_copies":1761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":12634,"num_write_kb":94903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12581,"ondisk_log_size":12581,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":450072,"kb_used_data":59576,"kb_used_omap":0,"kb_used_meta":390464,"kb_avail":377037288,"statfs":{"total":386547056640,"available":386086182912,"internally_reserved":0,"allocated":61005824,"data_stored":119159204,"data_compressed":6102420,"data_compressed_allocated":58343424,"data_compressed_original":118161408,"omap_allocated":0,"internal_metadata":399835136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-45547520,"num_objects":-695,"num_object_clones":0,"num_object_copies":-2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":695,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.049193"},"pg_stats":[{"pgid":"8.7","version":"76'982","reported_seq":1006,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.332284+0000","last_change":"2024-04-25T09:36:58.550801+0000","last_active":"2024-04-25T09:38:37.332284+0000","last_peered":"2024-04-25T09:38:37.332284+0000","last_clean":"2024-04-25T09:38:37.332284+0000","last_became_active":"2024-04-25T09:36:58.542284+0000","last_became_peered":"2024-04-25T09:36:58.542284+0000","last_unstale":"2024-04-25T09:38:37.332284+0000","last_undegraded":"2024-04-25T09:38:37.332284+0000","last_fullsized":"2024-04-25T09:38:37.332284+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":983,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"76'731","reported_seq":755,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.187810+0000","last_change":"2024-04-25T09:36:58.566425+0000","last_active":"2024-04-25T09:38:37.187810+0000","last_peered":"2024-04-25T09:38:37.187810+0000","last_clean":"2024-04-25T09:38:37.187810+0000","last_became_active":"2024-04-25T09:36:58.553672+0000","last_became_peered":"2024-04-25T09:36:58.553672+0000","last_unstale":"2024-04-25T09:38:37.187810+0000","last_undegraded":"2024-04-25T09:38:37.187810+0000","last_fullsized":"2024-04-25T09:38:37.187810+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"76'687","reported_seq":711,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.324786+0000","last_change":"2024-04-25T09:36:58.645637+0000","last_active":"2024-04-25T09:38:36.324786+0000","last_peered":"2024-04-25T09:38:36.324786+0000","last_clean":"2024-04-25T09:38:36.324786+0000","last_became_active":"2024-04-25T09:36:58.636058+0000","last_became_peered":"2024-04-25T09:36:58.636058+0000","last_unstale":"2024-04-25T09:38:36.324786+0000","last_undegraded":"2024-04-25T09:38:36.324786+0000","last_fullsized":"2024-04-25T09:38:36.324786+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"76'807","reported_seq":833,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.419787+0000","last_change":"2024-04-25T09:36:58.617321+0000","last_active":"2024-04-25T09:38:36.419787+0000","last_peered":"2024-04-25T09:38:36.419787+0000","last_clean":"2024-04-25T09:38:36.419787+0000","last_became_active":"2024-04-25T09:36:58.606984+0000","last_became_peered":"2024-04-25T09:36:58.606984+0000","last_unstale":"2024-04-25T09:38:36.419787+0000","last_undegraded":"2024-04-25T09:38:36.419787+0000","last_fullsized":"2024-04-25T09:38:36.419787+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":807,"log_dups_size":0,"ondisk_log_size":807,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"76'671","reported_seq":695,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.185182+0000","last_change":"2024-04-25T09:36:58.709778+0000","last_active":"2024-04-25T09:38:36.185182+0000","last_peered":"2024-04-25T09:38:36.185182+0000","last_clean":"2024-04-25T09:38:36.185182+0000","last_became_active":"2024-04-25T09:36:58.699632+0000","last_became_peered":"2024-04-25T09:36:58.699632+0000","last_unstale":"2024-04-25T09:38:36.185182+0000","last_undegraded":"2024-04-25T09:38:36.185182+0000","last_fullsized":"2024-04-25T09:38:36.185182+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"76'717","reported_seq":743,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.360355+0000","last_change":"2024-04-25T09:36:58.656094+0000","last_active":"2024-04-25T09:38:36.360355+0000","last_peered":"2024-04-25T09:38:36.360355+0000","last_clean":"2024-04-25T09:38:36.360355+0000","last_became_active":"2024-04-25T09:36:58.651078+0000","last_became_peered":"2024-04-25T09:36:58.651078+0000","last_unstale":"2024-04-25T09:38:36.360355+0000","last_undegraded":"2024-04-25T09:38:36.360355+0000","last_fullsized":"2024-04-25T09:38:36.360355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"76'939","reported_seq":963,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.345535+0000","last_change":"2024-04-25T09:36:58.627532+0000","last_active":"2024-04-25T09:38:37.345535+0000","last_peered":"2024-04-25T09:38:37.345535+0000","last_clean":"2024-04-25T09:38:37.345535+0000","last_became_active":"2024-04-25T09:36:58.601752+0000","last_became_peered":"2024-04-25T09:36:58.601752+0000","last_unstale":"2024-04-25T09:38:37.345535+0000","last_undegraded":"2024-04-25T09:38:37.345535+0000","last_fullsized":"2024-04-25T09:38:37.345535+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":940,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"76'830","reported_seq":854,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.419837+0000","last_change":"2024-04-25T09:36:58.677335+0000","last_active":"2024-04-25T09:38:36.419837+0000","last_peered":"2024-04-25T09:38:36.419837+0000","last_clean":"2024-04-25T09:38:36.419837+0000","last_became_active":"2024-04-25T09:36:58.666749+0000","last_became_peered":"2024-04-25T09:36:58.666749+0000","last_unstale":"2024-04-25T09:38:36.419837+0000","last_undegraded":"2024-04-25T09:38:36.419837+0000","last_fullsized":"2024-04-25T09:38:36.419837+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":830,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"76'773","reported_seq":799,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.389088+0000","last_change":"2024-04-25T09:36:58.622087+0000","last_active":"2024-04-25T09:38:36.389088+0000","last_peered":"2024-04-25T09:38:36.389088+0000","last_clean":"2024-04-25T09:38:36.389088+0000","last_became_active":"2024-04-25T09:36:58.613320+0000","last_became_peered":"2024-04-25T09:36:58.613320+0000","last_unstale":"2024-04-25T09:38:36.389088+0000","last_undegraded":"2024-04-25T09:38:36.389088+0000","last_fullsized":"2024-04-25T09:38:36.389088+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":306,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.531961+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:37:22.531961+0000","last_peered":"2024-04-25T09:37:22.531961+0000","last_clean":"2024-04-25T09:37:22.531961+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:37:22.531961+0000","last_undegraded":"2024-04-25T09:37:22.531961+0000","last_fullsized":"2024-04-25T09:37:22.531961+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":168,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.515939+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:36.515939+0000","last_peered":"2024-04-25T09:38:36.515939+0000","last_clean":"2024-04-25T09:38:36.515939+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:36.515939+0000","last_undegraded":"2024-04-25T09:38:36.515939+0000","last_fullsized":"2024-04-25T09:38:36.515939+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"76'850","reported_seq":874,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.299240+0000","last_change":"2024-04-25T09:36:58.652070+0000","last_active":"2024-04-25T09:38:37.299240+0000","last_peered":"2024-04-25T09:38:37.299240+0000","last_clean":"2024-04-25T09:38:37.299240+0000","last_became_active":"2024-04-25T09:36:58.643817+0000","last_became_peered":"2024-04-25T09:36:58.643817+0000","last_unstale":"2024-04-25T09:38:37.299240+0000","last_undegraded":"2024-04-25T09:38:37.299240+0000","last_fullsized":"2024-04-25T09:38:37.299240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":851,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.695926+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:37:22.695926+0000","last_peered":"2024-04-25T09:37:22.695926+0000","last_clean":"2024-04-25T09:37:22.695926+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:37:22.695926+0000","last_undegraded":"2024-04-25T09:37:22.695926+0000","last_fullsized":"2024-04-25T09:37:22.695926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"76'811","reported_seq":837,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.067495+0000","last_change":"2024-04-25T09:36:58.597421+0000","last_active":"2024-04-25T09:38:36.067495+0000","last_peered":"2024-04-25T09:38:36.067495+0000","last_clean":"2024-04-25T09:38:36.067495+0000","last_became_active":"2024-04-25T09:36:58.589781+0000","last_became_peered":"2024-04-25T09:36:58.589781+0000","last_unstale":"2024-04-25T09:38:36.067495+0000","last_undegraded":"2024-04-25T09:38:36.067495+0000","last_fullsized":"2024-04-25T09:38:36.067495+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3555328,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":812,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.500768+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:36.500768+0000","last_peered":"2024-04-25T09:38:36.500768+0000","last_clean":"2024-04-25T09:38:36.500768+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:36.500768+0000","last_undegraded":"2024-04-25T09:38:36.500768+0000","last_fullsized":"2024-04-25T09:38:36.500768+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"76'769","reported_seq":795,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.494758+0000","last_change":"2024-04-25T09:36:58.692891+0000","last_active":"2024-04-25T09:38:36.494758+0000","last_peered":"2024-04-25T09:38:36.494758+0000","last_clean":"2024-04-25T09:38:36.494758+0000","last_became_active":"2024-04-25T09:36:58.683227+0000","last_became_peered":"2024-04-25T09:36:58.683227+0000","last_unstale":"2024-04-25T09:38:36.494758+0000","last_undegraded":"2024-04-25T09:38:36.494758+0000","last_fullsized":"2024-04-25T09:38:36.494758+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.701065+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:37:22.701065+0000","last_peered":"2024-04-25T09:37:22.701065+0000","last_clean":"2024-04-25T09:37:22.701065+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:37:22.701065+0000","last_undegraded":"2024-04-25T09:37:22.701065+0000","last_fullsized":"2024-04-25T09:37:22.701065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"76'651","reported_seq":677,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.446406+0000","last_change":"2024-04-25T09:36:58.574190+0000","last_active":"2024-04-25T09:38:36.446406+0000","last_peered":"2024-04-25T09:38:36.446406+0000","last_clean":"2024-04-25T09:38:36.446406+0000","last_became_active":"2024-04-25T09:36:58.567016+0000","last_became_peered":"2024-04-25T09:36:58.567016+0000","last_unstale":"2024-04-25T09:38:36.446406+0000","last_undegraded":"2024-04-25T09:38:36.446406+0000","last_fullsized":"2024-04-25T09:38:36.446406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":652,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.524873+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:37:22.524873+0000","last_peered":"2024-04-25T09:37:22.524873+0000","last_clean":"2024-04-25T09:37:22.524873+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:37:22.524873+0000","last_undegraded":"2024-04-25T09:37:22.524873+0000","last_fullsized":"2024-04-25T09:37:22.524873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"76'730","reported_seq":754,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:37.056308+0000","last_change":"2024-04-25T09:36:58.595826+0000","last_active":"2024-04-25T09:38:37.056308+0000","last_peered":"2024-04-25T09:38:37.056308+0000","last_clean":"2024-04-25T09:38:37.056308+0000","last_became_active":"2024-04-25T09:36:58.584820+0000","last_became_peered":"2024-04-25T09:36:58.584820+0000","last_unstale":"2024-04-25T09:38:37.056308+0000","last_undegraded":"2024-04-25T09:38:37.056308+0000","last_fullsized":"2024-04-25T09:38:37.056308+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":731,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":173,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.538652+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:37:22.538652+0000","last_peered":"2024-04-25T09:37:22.538652+0000","last_clean":"2024-04-25T09:37:22.538652+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:37:22.538652+0000","last_undegraded":"2024-04-25T09:37:22.538652+0000","last_fullsized":"2024-04-25T09:37:22.538652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"76'775","reported_seq":801,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.224886+0000","last_change":"2024-04-25T09:36:58.675756+0000","last_active":"2024-04-25T09:38:36.224886+0000","last_peered":"2024-04-25T09:38:36.224886+0000","last_clean":"2024-04-25T09:38:36.224886+0000","last_became_active":"2024-04-25T09:36:58.667918+0000","last_became_peered":"2024-04-25T09:36:58.667918+0000","last_unstale":"2024-04-25T09:38:36.224886+0000","last_undegraded":"2024-04-25T09:38:36.224886+0000","last_fullsized":"2024-04-25T09:38:36.224886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.512330+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:37:22.512330+0000","last_peered":"2024-04-25T09:37:22.512330+0000","last_clean":"2024-04-25T09:37:22.512330+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:37:22.512330+0000","last_undegraded":"2024-04-25T09:37:22.512330+0000","last_fullsized":"2024-04-25T09:37:22.512330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"76'761","reported_seq":788,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-04-25T09:38:36.333139+0000","last_change":"2024-04-25T09:36:58.554621+0000","last_active":"2024-04-25T09:38:36.333139+0000","last_peered":"2024-04-25T09:38:36.333139+0000","last_clean":"2024-04-25T09:38:36.333139+0000","last_became_active":"2024-04-25T09:36:58.543754+0000","last_became_peered":"2024-04-25T09:36:58.543754+0000","last_unstale":"2024-04-25T09:38:36.333139+0000","last_undegraded":"2024-04-25T09:38:36.333139+0000","last_fullsized":"2024-04-25T09:38:36.333139+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:36:57.390740+0000","last_clean_scrub_stamp":"2024-04-25T09:36:57.390740+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621464,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":762,"num_write_kb":5697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-04-25T09:37:22.473993+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:37:22.473993+0000","last_peered":"2024-04-25T09:37:22.473993+0000","last_clean":"2024-04-25T09:37:22.473993+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:37:22.473993+0000","last_undegraded":"2024-04-25T09:37:22.473993+0000","last_fullsized":"2024-04-25T09:37:22.473993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":38223896,"num_objects":585,"num_object_clones":0,"num_object_copies":1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12497,"num_write_kb":93009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55873536,"data_stored":111722568,"data_compressed":5768871,"data_compressed_allocated":55861248,"data_compressed_original":111722496,"omap_allocated":0,"internal_metadata":0},"log_size":12484,"ondisk_log_size":12484,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116060,"kb_used_data":12884,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94255780,"statfs":{"total":96636764160,"available":96517918720,"internally_reserved":0,"allocated":13193216,"data_stored":25796319,"data_compressed":1319271,"data_compressed_allocated":12525568,"data_compressed_original":25542656,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91496,"kb_used_data":10528,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94280344,"statfs":{"total":96636764160,"available":96543072256,"internally_reserved":0,"allocated":10780672,"data_stored":20963063,"data_compressed":1069700,"data_compressed_allocated":10108928,"data_compressed_original":20709376,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117900,"kb_used_data":18884,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94253940,"statfs":{"total":96636764160,"available":96516034560,"internally_reserved":0,"allocated":19337216,"data_stored":37608663,"data_compressed":1929725,"data_compressed_allocated":18685952,"data_compressed_original":37371904,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706318,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124616,"kb_used_data":17280,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94247224,"statfs":{"total":96636764160,"available":96509157376,"internally_reserved":0,"allocated":17694720,"data_stored":34791159,"data_compressed":1783724,"data_compressed_allocated":17022976,"data_compressed_original":34537472,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16297984,"data_stored":32587800,"data_compressed":1682693,"data_compressed_allocated":16293888,"data_compressed_original":32587776,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18231296,"data_stored":36454424,"data_compressed":1882349,"data_compressed_allocated":18227200,"data_compressed_original":36454400,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9220096,"data_stored":18432024,"data_compressed":951749,"data_compressed_allocated":9216000,"data_compressed_original":18432000,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12124160,"data_stored":24248320,"data_compressed":1252080,"data_compressed_allocated":12124160,"data_compressed_original":24248320,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:41.058 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:41.191 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:41.199+0000 7face3e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:41.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:41.208+0000 7face3e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:41.360 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1454 objects 2024-04-25T09:38:41.360 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :10.841 2024-04-25T09:38:43.134 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_5 2024-04-25T09:38:43.134 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2024-04-25T09:38:43.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:43.255+0000 7feeadaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:43.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:43.268+0000 7feeadaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:43.433 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:43.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:43.547+0000 7f44c9c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:43.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:43.552+0000 7f44c9c2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:44.448 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_5' removed 2024-04-25T09:38:44.463 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:38:44.464 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:38:44.464 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_6 2024-04-25T09:38:44.464 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_6 16 2024-04-25T09:38:44.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:44.581+0000 7f25a786d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:44.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:44.592+0000 7f25a786d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:45.452 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_6' created 2024-04-25T09:38:45.475 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2024-04-25T09:38:45.640 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:45.651 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:45.646+0000 7fa2ce11d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:45.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:45.668+0000 7fa2ce11d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:45.698 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:45.699 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:45.699 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:45.809 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:45.816+0000 7f489d22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:45.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:45.835+0000 7f489d22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:45.874 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:45.880+0000 7fd623c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:45.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:45.889+0000 7fd623c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:46.094 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:46.094 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:46.106 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-04-25T09:38:45.463089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":405532,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":402944,"kb_avail":377081828,"statfs":{"total":386547056640,"available":386131791872,"internally_reserved":0,"allocated":2207744,"data_stored":2554001,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":412614656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-38223896,"num_objects":-585,"num_object_clones":0,"num_object_copies":-1755,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-12497,"num_write_kb":-93009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.097389"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":312,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:39.551356+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:38:39.551356+0000","last_peered":"2024-04-25T09:38:39.551356+0000","last_clean":"2024-04-25T09:38:39.551356+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:38:39.551356+0000","last_undegraded":"2024-04-25T09:38:39.551356+0000","last_fullsized":"2024-04-25T09:38:39.551356+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:40.637355+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:40.637355+0000","last_peered":"2024-04-25T09:38:40.637355+0000","last_clean":"2024-04-25T09:38:40.637355+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:40.637355+0000","last_undegraded":"2024-04-25T09:38:40.637355+0000","last_fullsized":"2024-04-25T09:38:40.637355+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":177,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:40.591610+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:38:40.591610+0000","last_peered":"2024-04-25T09:38:40.591610+0000","last_clean":"2024-04-25T09:38:40.591610+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:38:40.591610+0000","last_undegraded":"2024-04-25T09:38:40.591610+0000","last_fullsized":"2024-04-25T09:38:40.591610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:40.609653+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:40.609653+0000","last_peered":"2024-04-25T09:38:40.609653+0000","last_clean":"2024-04-25T09:38:40.609653+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:40.609653+0000","last_undegraded":"2024-04-25T09:38:40.609653+0000","last_fullsized":"2024-04-25T09:38:40.609653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:40.626111+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:38:40.626111+0000","last_peered":"2024-04-25T09:38:40.626111+0000","last_clean":"2024-04-25T09:38:40.626111+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:38:40.626111+0000","last_undegraded":"2024-04-25T09:38:40.626111+0000","last_fullsized":"2024-04-25T09:38:40.626111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:40.625177+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:38:40.625177+0000","last_peered":"2024-04-25T09:38:40.625177+0000","last_clean":"2024-04-25T09:38:40.625177+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:38:40.625177+0000","last_undegraded":"2024-04-25T09:38:40.625177+0000","last_fullsized":"2024-04-25T09:38:40.625177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:39.579408+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:38:39.579408+0000","last_peered":"2024-04-25T09:38:39.579408+0000","last_clean":"2024-04-25T09:38:39.579408+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:38:39.579408+0000","last_undegraded":"2024-04-25T09:38:39.579408+0000","last_fullsized":"2024-04-25T09:38:39.579408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":177,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:40.618524+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:38:40.618524+0000","last_peered":"2024-04-25T09:38:40.618524+0000","last_clean":"2024-04-25T09:38:40.618524+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:38:40.618524+0000","last_undegraded":"2024-04-25T09:38:40.618524+0000","last_fullsized":"2024-04-25T09:38:40.618524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:38:45.459961+0000","last_change":"2024-04-25T09:38:45.459961+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.459961+0000","last_undegraded":"2024-04-25T09:38:45.459961+0000","last_fullsized":"2024-04-25T09:38:45.459961+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":175,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:38:40.615572+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:38:40.615572+0000","last_peered":"2024-04-25T09:38:40.615572+0000","last_clean":"2024-04-25T09:38:40.615572+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:38:40.615572+0000","last_undegraded":"2024-04-25T09:38:40.615572+0000","last_fullsized":"2024-04-25T09:38:40.615572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108060,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94263780,"statfs":{"total":96636764160,"available":96526110720,"internally_reserved":0,"allocated":651264,"data_stored":820872,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673619,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81692,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290148,"statfs":{"total":96636764160,"available":96553111552,"internally_reserved":0,"allocated":536576,"data_stored":774483,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103652,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94268188,"statfs":{"total":96636764160,"available":96530624512,"internally_reserved":0,"allocated":479232,"data_stored":184139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112128,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259712,"statfs":{"total":96636764160,"available":96521945088,"internally_reserved":0,"allocated":540672,"data_stored":774507,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:46.456 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_6' 2024-04-25T09:38:47.475 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_6 bench 90 write' 2024-04-25T09:38:47.478 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:38:47.478 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:38:47.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:38:47.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:38:47.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_56635 2024-04-25T09:38:47.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:38:47.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:38:48.001 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:48.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:48.141+0000 7f464d79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:48.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:48.147+0000 7f464d79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:48.544 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 163 147 1.14837 1.14844 0.0475544 0.101206 2024-04-25T09:38:49.544 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 325 309 1.20693 1.26562 0.170514 0.10045 2024-04-25T09:38:50.296 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:50.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:50.458+0000 7fd2e2f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:50.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:50.466+0000 7fd2e2f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:50.544 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 470 454 1.18219 1.13281 0.0688516 0.103497 2024-04-25T09:38:51.108 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:51.108 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:38:51.109 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:38:51.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:51.238+0000 7f25c726d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:51.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:51.248+0000 7f25c726d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:51.544 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 612 596 1.16397 1.10938 0.060547 0.105549 2024-04-25T09:38:51.589 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:38:51.589 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:38:51.606 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":412,"stamp":"2024-04-25T09:38:51.368204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":405220,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":402944,"kb_avail":377082140,"statfs":{"total":386547056640,"available":386132111360,"internally_reserved":0,"allocated":2183168,"data_stored":2542018,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":412614656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-04-25T09:38:45.705988+0000","last_change":"2024-04-25T09:38:45.705988+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.705988+0000","last_undegraded":"2024-04-25T09:38:45.705988+0000","last_fullsized":"2024-04-25T09:38:45.705988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":3,"reported_epoch":83,"state":"creating+activating","last_fresh":"2024-04-25T09:38:46.495210+0000","last_change":"2024-04-25T09:38:46.497471+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:46.495210+0000","last_undegraded":"2024-04-25T09:38:46.495210+0000","last_fullsized":"2024-04-25T09:38:46.495210+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":["1","2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.652477+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:38:46.652477+0000","last_peered":"2024-04-25T09:38:46.652477+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:38:46.652477+0000","last_undegraded":"2024-04-25T09:38:46.652477+0000","last_fullsized":"2024-04-25T09:38:46.652477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.656746+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:38:46.656746+0000","last_peered":"2024-04-25T09:38:46.656746+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:38:46.656746+0000","last_undegraded":"2024-04-25T09:38:46.656746+0000","last_fullsized":"2024-04-25T09:38:46.656746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.500825+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:38:47.500825+0000","last_peered":"2024-04-25T09:38:47.500825+0000","last_clean":"2024-04-25T09:38:47.500825+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:38:47.500825+0000","last_undegraded":"2024-04-25T09:38:47.500825+0000","last_fullsized":"2024-04-25T09:38:47.500825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2024-04-25T09:38:45.643908+0000","last_change":"2024-04-25T09:38:45.643908+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:45.643908+0000","last_undegraded":"2024-04-25T09:38:45.643908+0000","last_fullsized":"2024-04-25T09:38:45.643908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":3,"reported_epoch":83,"state":"creating+activating","last_fresh":"2024-04-25T09:38:46.511197+0000","last_change":"2024-04-25T09:38:46.513866+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:46.511197+0000","last_undegraded":"2024-04-25T09:38:46.511197+0000","last_fullsized":"2024-04-25T09:38:46.511197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.740789+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:38:46.740789+0000","last_peered":"2024-04-25T09:38:46.740789+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:38:46.740789+0000","last_undegraded":"2024-04-25T09:38:46.740789+0000","last_fullsized":"2024-04-25T09:38:46.740789+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.489160+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:38:47.489160+0000","last_peered":"2024-04-25T09:38:47.489160+0000","last_clean":"2024-04-25T09:38:47.489160+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:38:47.489160+0000","last_undegraded":"2024-04-25T09:38:47.489160+0000","last_fullsized":"2024-04-25T09:38:47.489160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":322,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.487329+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:38:47.487329+0000","last_peered":"2024-04-25T09:38:47.487329+0000","last_clean":"2024-04-25T09:38:47.487329+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:38:47.487329+0000","last_undegraded":"2024-04-25T09:38:47.487329+0000","last_fullsized":"2024-04-25T09:38:47.487329+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:45.584980+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:45.584980+0000","last_peered":"2024-04-25T09:38:45.584980+0000","last_clean":"2024-04-25T09:38:45.584980+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:45.584980+0000","last_undegraded":"2024-04-25T09:38:45.584980+0000","last_fullsized":"2024-04-25T09:38:45.584980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":3,"reported_epoch":83,"state":"creating+activating","last_fresh":"2024-04-25T09:38:46.503517+0000","last_change":"2024-04-25T09:38:46.506362+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:46.503517+0000","last_undegraded":"2024-04-25T09:38:46.503517+0000","last_fullsized":"2024-04-25T09:38:46.503517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":["0","1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.518824+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:38:46.518824+0000","last_peered":"2024-04-25T09:38:46.518824+0000","last_clean":"2024-04-25T09:38:46.518824+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:38:46.518824+0000","last_undegraded":"2024-04-25T09:38:46.518824+0000","last_fullsized":"2024-04-25T09:38:46.518824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.597766+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:38:46.597766+0000","last_peered":"2024-04-25T09:38:46.597766+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:38:46.597766+0000","last_undegraded":"2024-04-25T09:38:46.597766+0000","last_fullsized":"2024-04-25T09:38:46.597766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.502834+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:46.502834+0000","last_peered":"2024-04-25T09:38:46.502834+0000","last_clean":"2024-04-25T09:38:46.502834+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:46.502834+0000","last_undegraded":"2024-04-25T09:38:46.502834+0000","last_fullsized":"2024-04-25T09:38:46.502834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.492157+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:38:47.492157+0000","last_peered":"2024-04-25T09:38:47.492157+0000","last_clean":"2024-04-25T09:38:47.492157+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:38:47.492157+0000","last_undegraded":"2024-04-25T09:38:47.492157+0000","last_fullsized":"2024-04-25T09:38:47.492157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":184,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.508374+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:38:46.508374+0000","last_peered":"2024-04-25T09:38:46.508374+0000","last_clean":"2024-04-25T09:38:46.508374+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:38:46.508374+0000","last_undegraded":"2024-04-25T09:38:46.508374+0000","last_fullsized":"2024-04-25T09:38:46.508374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":3,"reported_epoch":83,"state":"creating+activating","last_fresh":"2024-04-25T09:38:46.506820+0000","last_change":"2024-04-25T09:38:46.509925+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:46.506820+0000","last_undegraded":"2024-04-25T09:38:46.506820+0000","last_fullsized":"2024-04-25T09:38:46.506820+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":["0","1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":186,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.509284+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:38:46.509284+0000","last_peered":"2024-04-25T09:38:46.509284+0000","last_clean":"2024-04-25T09:38:46.509284+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:38:46.509284+0000","last_undegraded":"2024-04-25T09:38:46.509284+0000","last_fullsized":"2024-04-25T09:38:46.509284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":3,"reported_epoch":83,"state":"creating+activating","last_fresh":"2024-04-25T09:38:46.491569+0000","last_change":"2024-04-25T09:38:46.493363+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:46.491569+0000","last_undegraded":"2024-04-25T09:38:46.491569+0000","last_fullsized":"2024-04-25T09:38:46.491569+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.494614+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:38:47.494614+0000","last_peered":"2024-04-25T09:38:47.494614+0000","last_clean":"2024-04-25T09:38:47.494614+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:38:47.494614+0000","last_undegraded":"2024-04-25T09:38:47.494614+0000","last_fullsized":"2024-04-25T09:38:47.494614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.493406+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:38:47.493406+0000","last_peered":"2024-04-25T09:38:47.493406+0000","last_clean":"2024-04-25T09:38:47.493406+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:38:47.493406+0000","last_undegraded":"2024-04-25T09:38:47.493406+0000","last_fullsized":"2024-04-25T09:38:47.493406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":186,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:46.523171+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:38:46.523171+0000","last_peered":"2024-04-25T09:38:46.523171+0000","last_clean":"2024-04-25T09:38:46.523171+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:38:46.523171+0000","last_undegraded":"2024-04-25T09:38:46.523171+0000","last_fullsized":"2024-04-25T09:38:46.523171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":3,"reported_epoch":83,"state":"creating+activating","last_fresh":"2024-04-25T09:38:46.492197+0000","last_change":"2024-04-25T09:38:46.494041+0000","last_active":"2024-04-25T09:38:45.459961+0000","last_peered":"2024-04-25T09:38:45.459961+0000","last_clean":"2024-04-25T09:38:45.459961+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:38:46.492197+0000","last_undegraded":"2024-04-25T09:38:46.492197+0000","last_fullsized":"2024-04-25T09:38:46.492197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":["1","0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":179,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-25T09:38:45.600823+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:38:45.600823+0000","last_peered":"2024-04-25T09:38:45.600823+0000","last_clean":"2024-04-25T09:38:45.600823+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:38:45.600823+0000","last_undegraded":"2024-04-25T09:38:45.600823+0000","last_fullsized":"2024-04-25T09:38:45.600823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673624,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108000,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94263840,"statfs":{"total":96636764160,"available":96526172160,"internally_reserved":0,"allocated":565248,"data_stored":784901,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673624,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81520,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290320,"statfs":{"total":96636764160,"available":96553287680,"internally_reserved":0,"allocated":565248,"data_stored":784901,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103660,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94268180,"statfs":{"total":96636764160,"available":96530616320,"internally_reserved":0,"allocated":495616,"data_stored":190924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706328,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112040,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259800,"statfs":{"total":96636764160,"available":96522035200,"internally_reserved":0,"allocated":557056,"data_stored":781292,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:38:52.545 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 754 738 1.15303 1.10938 0.0348443 0.106913 2024-04-25T09:38:52.666 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:52.789 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:52.797+0000 7fce58a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:52.794 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:52.803+0000 7fce58a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:53.545 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 908 892 1.16136 1.20312 0.0685388 0.106441 2024-04-25T09:38:54.545 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 1049 1033 1.1528 1.10156 0.108024 0.107337 2024-04-25T09:38:54.942 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:55.060 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:55.068+0000 7ff49d02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:55.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:55.075+0000 7ff49d02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:55.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1203 1187 1.15907 1.20312 0.137298 0.106908 2024-04-25T09:38:56.545 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1347 1331 1.15528 1.125 0.124573 0.107585 2024-04-25T09:38:56.608 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:38:56.609 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:38:56.732 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:56.733+0000 7fc2dab5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:56.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:56.746+0000 7fc2dab5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:57.291 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:38:57.374 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:38:57.396 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:38:57.416 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:57.423+0000 7fb86d35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:57.421 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:57.430+0000 7fb86d35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:57.534 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:57.533+0000 7f612cb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:57.538 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:57.548+0000 7f612cb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:57.545 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 1480 1464 1.14365 1.03906 0.165257 0.108365 2024-04-25T09:38:58.381 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:38:58.400 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:38:58.545 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1616 1600 1.13626 1.0625 0.278923 0.108711 2024-04-25T09:38:58.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:58.548+0000 7f37800ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:58.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:58.562+0000 7f37800ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:59.391 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:38:59.405 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:38:59.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1750 1734 1.12881 1.04688 0.11099 0.109748 2024-04-25T09:38:59.550 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:59.552+0000 7faa2b79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:59.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:59.564+0000 7faa2b79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:59.608 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:38:59.737 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:59.744+0000 7feaba42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:38:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:38:59.751+0000 7feaba42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:00.392 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:39:00.411 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:39:00.411 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:39:00.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:00.537+0000 7f8290d10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:00.536 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:00.546+0000 7f8290d10640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:00.545 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 1885 1869 1.1231 1.05469 0.159953 0.11049 2024-04-25T09:39:00.786 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:39:00.787 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:39:00.809 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2024-04-25T09:39:00.402251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12214816,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1556,"num_write_kb":13246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1503,"ondisk_log_size":1503,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":421616,"kb_used_data":18640,"kb_used_omap":0,"kb_used_meta":402944,"kb_avail":377065744,"statfs":{"total":386547056640,"available":386115321856,"internally_reserved":0,"allocated":19087360,"data_stored":36273624,"data_compressed":1827216,"data_compressed_allocated":16977920,"data_compressed_original":35430400,"omap_allocated":0,"internal_metadata":412614656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5947392,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":5808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.033147"},"pg_stats":[{"pgid":"9.7","version":"84'119","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.494207+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:38:56.494207+0000","last_peered":"2024-04-25T09:38:56.494207+0000","last_clean":"2024-04-25T09:38:56.494207+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:38:56.494207+0000","last_undegraded":"2024-04-25T09:38:56.494207+0000","last_fullsized":"2024-04-25T09:38:56.494207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"84'55","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.315241+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:38:55.315241+0000","last_peered":"2024-04-25T09:38:55.315241+0000","last_clean":"2024-04-25T09:38:55.315241+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:38:55.315241+0000","last_undegraded":"2024-04-25T09:38:55.315241+0000","last_fullsized":"2024-04-25T09:38:55.315241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"84'104","reported_seq":119,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.414855+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:38:57.414855+0000","last_peered":"2024-04-25T09:38:57.414855+0000","last_clean":"2024-04-25T09:38:57.414855+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:38:57.414855+0000","last_undegraded":"2024-04-25T09:38:57.414855+0000","last_fullsized":"2024-04-25T09:38:57.414855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"84'120","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.401209+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:38:57.401209+0000","last_peered":"2024-04-25T09:38:57.401209+0000","last_clean":"2024-04-25T09:38:57.401209+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:38:57.401209+0000","last_undegraded":"2024-04-25T09:38:57.401209+0000","last_fullsized":"2024-04-25T09:38:57.401209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"84'103","reported_seq":116,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.092192+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:38:57.092192+0000","last_peered":"2024-04-25T09:38:57.092192+0000","last_clean":"2024-04-25T09:38:57.092192+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:38:57.092192+0000","last_undegraded":"2024-04-25T09:38:57.092192+0000","last_fullsized":"2024-04-25T09:38:57.092192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"84'71","reported_seq":84,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.261191+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:38:56.261191+0000","last_peered":"2024-04-25T09:38:56.261191+0000","last_clean":"2024-04-25T09:38:56.261191+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:38:56.261191+0000","last_undegraded":"2024-04-25T09:38:56.261191+0000","last_fullsized":"2024-04-25T09:38:56.261191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"84'103","reported_seq":116,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.433163+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:38:56.433163+0000","last_peered":"2024-04-25T09:38:56.433163+0000","last_clean":"2024-04-25T09:38:56.433163+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:38:56.433163+0000","last_undegraded":"2024-04-25T09:38:56.433163+0000","last_fullsized":"2024-04-25T09:38:56.433163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"85'63","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.443386+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:38:57.443386+0000","last_peered":"2024-04-25T09:38:57.443386+0000","last_clean":"2024-04-25T09:38:57.443386+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:38:57.443386+0000","last_undegraded":"2024-04-25T09:38:57.443386+0000","last_fullsized":"2024-04-25T09:38:57.443386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"84'87","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.892549+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:38:55.892549+0000","last_peered":"2024-04-25T09:38:55.892549+0000","last_clean":"2024-04-25T09:38:55.892549+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:38:55.892549+0000","last_undegraded":"2024-04-25T09:38:55.892549+0000","last_fullsized":"2024-04-25T09:38:55.892549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":322,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.487329+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:38:47.487329+0000","last_peered":"2024-04-25T09:38:47.487329+0000","last_clean":"2024-04-25T09:38:47.487329+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:38:47.487329+0000","last_undegraded":"2024-04-25T09:38:47.487329+0000","last_fullsized":"2024-04-25T09:38:47.487329+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.611356+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:47.611356+0000","last_peered":"2024-04-25T09:38:47.611356+0000","last_clean":"2024-04-25T09:38:47.611356+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:47.611356+0000","last_undegraded":"2024-04-25T09:38:47.611356+0000","last_fullsized":"2024-04-25T09:38:47.611356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"84'87","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.006521+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:38:56.006521+0000","last_peered":"2024-04-25T09:38:56.006521+0000","last_clean":"2024-04-25T09:38:56.006521+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:38:56.006521+0000","last_undegraded":"2024-04-25T09:38:56.006521+0000","last_fullsized":"2024-04-25T09:38:56.006521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.601951+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:38:47.601951+0000","last_peered":"2024-04-25T09:38:47.601951+0000","last_clean":"2024-04-25T09:38:47.601951+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:38:47.601951+0000","last_undegraded":"2024-04-25T09:38:47.601951+0000","last_fullsized":"2024-04-25T09:38:47.601951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"84'112","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.402223+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:38:57.402223+0000","last_peered":"2024-04-25T09:38:57.402223+0000","last_clean":"2024-04-25T09:38:57.402223+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:38:57.402223+0000","last_undegraded":"2024-04-25T09:38:57.402223+0000","last_fullsized":"2024-04-25T09:38:57.402223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.584522+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:47.584522+0000","last_peered":"2024-04-25T09:38:47.584522+0000","last_clean":"2024-04-25T09:38:47.584522+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:47.584522+0000","last_undegraded":"2024-04-25T09:38:47.584522+0000","last_fullsized":"2024-04-25T09:38:47.584522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"84'106","reported_seq":119,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.456690+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:38:57.456690+0000","last_peered":"2024-04-25T09:38:57.456690+0000","last_clean":"2024-04-25T09:38:57.456690+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:38:57.456690+0000","last_undegraded":"2024-04-25T09:38:57.456690+0000","last_fullsized":"2024-04-25T09:38:57.456690+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876544,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.592331+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:38:47.592331+0000","last_peered":"2024-04-25T09:38:47.592331+0000","last_clean":"2024-04-25T09:38:47.592331+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:38:47.592331+0000","last_undegraded":"2024-04-25T09:38:47.592331+0000","last_fullsized":"2024-04-25T09:38:47.592331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"84'55","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.359514+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:38:55.359514+0000","last_peered":"2024-04-25T09:38:55.359514+0000","last_clean":"2024-04-25T09:38:55.359514+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:38:55.359514+0000","last_undegraded":"2024-04-25T09:38:55.359514+0000","last_fullsized":"2024-04-25T09:38:55.359514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":192,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.402672+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:38:57.402672+0000","last_peered":"2024-04-25T09:38:57.402672+0000","last_clean":"2024-04-25T09:38:57.402672+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:38:57.402672+0000","last_undegraded":"2024-04-25T09:38:57.402672+0000","last_fullsized":"2024-04-25T09:38:57.402672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"84'63","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.342822+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:38:56.342822+0000","last_peered":"2024-04-25T09:38:56.342822+0000","last_clean":"2024-04-25T09:38:56.342822+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:38:56.342822+0000","last_undegraded":"2024-04-25T09:38:56.342822+0000","last_fullsized":"2024-04-25T09:38:56.342822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.494614+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:38:47.494614+0000","last_peered":"2024-04-25T09:38:47.494614+0000","last_clean":"2024-04-25T09:38:47.494614+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:38:47.494614+0000","last_undegraded":"2024-04-25T09:38:47.494614+0000","last_fullsized":"2024-04-25T09:38:47.494614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"84'103","reported_seq":116,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.538332+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:38:55.538332+0000","last_peered":"2024-04-25T09:38:55.538332+0000","last_clean":"2024-04-25T09:38:55.538332+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:38:55.538332+0000","last_undegraded":"2024-04-25T09:38:55.538332+0000","last_fullsized":"2024-04-25T09:38:55.538332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":192,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.400363+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:38:57.400363+0000","last_peered":"2024-04-25T09:38:57.400363+0000","last_clean":"2024-04-25T09:38:57.400363+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:38:57.400363+0000","last_undegraded":"2024-04-25T09:38:57.400363+0000","last_fullsized":"2024-04-25T09:38:57.400363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"84'55","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:54.900836+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:38:54.900836+0000","last_peered":"2024-04-25T09:38:54.900836+0000","last_clean":"2024-04-25T09:38:54.900836+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:38:54.900836+0000","last_undegraded":"2024-04-25T09:38:54.900836+0000","last_fullsized":"2024-04-25T09:38:54.900836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.583008+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:38:47.583008+0000","last_peered":"2024-04-25T09:38:47.583008+0000","last_clean":"2024-04-25T09:38:47.583008+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:38:47.583008+0000","last_undegraded":"2024-04-25T09:38:47.583008+0000","last_fullsized":"2024-04-25T09:38:47.583008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":11624448,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1419,"num_write_kb":11352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17162240,"data_stored":34324480,"data_compressed":1769040,"data_compressed_allocated":17162240,"data_compressed_original":34324480,"omap_allocated":0,"internal_metadata":0},"log_size":1406,"ondisk_log_size":1406,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116952,"kb_used_data":5456,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94254888,"statfs":{"total":96636764160,"available":96517005312,"internally_reserved":0,"allocated":5586944,"data_stored":10815486,"data_compressed":546763,"data_compressed_allocated":5054464,"data_compressed_original":10600448,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89288,"kb_used_data":4160,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94282552,"statfs":{"total":96636764160,"available":96545333248,"internally_reserved":0,"allocated":4259840,"data_stored":8161278,"data_compressed":409965,"data_compressed_allocated":3727360,"data_compressed_original":7946240,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110792,"kb_used_data":3456,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94261048,"statfs":{"total":96636764160,"available":96523313152,"internally_reserved":0,"allocated":3538944,"data_stored":6251998,"data_compressed":311971,"data_compressed_allocated":3026944,"data_compressed_original":6053888,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104584,"kb_used_data":5568,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94267256,"statfs":{"total":96636764160,"available":96529670144,"internally_reserved":0,"allocated":5701632,"data_stored":11044862,"data_compressed":558517,"data_compressed_allocated":5169152,"data_compressed_original":10829824,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5206016,"data_stored":10412032,"data_compressed":536587,"data_compressed_allocated":5206016,"data_compressed_original":10412032,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3076096,"data_stored":6152192,"data_compressed":317047,"data_compressed_allocated":3076096,"data_compressed_original":6152192,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3854336,"data_stored":7708672,"data_compressed":397341,"data_compressed_allocated":3854336,"data_compressed_original":7708672,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5025792,"data_stored":10051584,"data_compressed":518065,"data_compressed_allocated":5025792,"data_compressed_original":10051584,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:39:00.811 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:39:00.942 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:00.946+0000 7fb62e39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:00.947 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:00.956+0000 7fb62e39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.205 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:39:01.206 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:39:01.224 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2024-04-25T09:39:00.402251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":12214816,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1556,"num_write_kb":13246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1503,"ondisk_log_size":1503,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":421616,"kb_used_data":18640,"kb_used_omap":0,"kb_used_meta":402944,"kb_avail":377065744,"statfs":{"total":386547056640,"available":386115321856,"internally_reserved":0,"allocated":19087360,"data_stored":36273624,"data_compressed":1827216,"data_compressed_allocated":16977920,"data_compressed_original":35430400,"omap_allocated":0,"internal_metadata":412614656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5947392,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":5808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.033147"},"pg_stats":[{"pgid":"9.7","version":"84'119","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.494207+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:38:56.494207+0000","last_peered":"2024-04-25T09:38:56.494207+0000","last_clean":"2024-04-25T09:38:56.494207+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:38:56.494207+0000","last_undegraded":"2024-04-25T09:38:56.494207+0000","last_fullsized":"2024-04-25T09:38:56.494207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"84'55","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.315241+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:38:55.315241+0000","last_peered":"2024-04-25T09:38:55.315241+0000","last_clean":"2024-04-25T09:38:55.315241+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:38:55.315241+0000","last_undegraded":"2024-04-25T09:38:55.315241+0000","last_fullsized":"2024-04-25T09:38:55.315241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"84'104","reported_seq":119,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.414855+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:38:57.414855+0000","last_peered":"2024-04-25T09:38:57.414855+0000","last_clean":"2024-04-25T09:38:57.414855+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:38:57.414855+0000","last_undegraded":"2024-04-25T09:38:57.414855+0000","last_fullsized":"2024-04-25T09:38:57.414855+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"84'120","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.401209+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:38:57.401209+0000","last_peered":"2024-04-25T09:38:57.401209+0000","last_clean":"2024-04-25T09:38:57.401209+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:38:57.401209+0000","last_undegraded":"2024-04-25T09:38:57.401209+0000","last_fullsized":"2024-04-25T09:38:57.401209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"84'103","reported_seq":116,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.092192+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:38:57.092192+0000","last_peered":"2024-04-25T09:38:57.092192+0000","last_clean":"2024-04-25T09:38:57.092192+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:38:57.092192+0000","last_undegraded":"2024-04-25T09:38:57.092192+0000","last_fullsized":"2024-04-25T09:38:57.092192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"84'71","reported_seq":84,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.261191+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:38:56.261191+0000","last_peered":"2024-04-25T09:38:56.261191+0000","last_clean":"2024-04-25T09:38:56.261191+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:38:56.261191+0000","last_undegraded":"2024-04-25T09:38:56.261191+0000","last_fullsized":"2024-04-25T09:38:56.261191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"84'103","reported_seq":116,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.433163+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:38:56.433163+0000","last_peered":"2024-04-25T09:38:56.433163+0000","last_clean":"2024-04-25T09:38:56.433163+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:38:56.433163+0000","last_undegraded":"2024-04-25T09:38:56.433163+0000","last_fullsized":"2024-04-25T09:38:56.433163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"85'63","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.443386+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:38:57.443386+0000","last_peered":"2024-04-25T09:38:57.443386+0000","last_clean":"2024-04-25T09:38:57.443386+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:38:57.443386+0000","last_undegraded":"2024-04-25T09:38:57.443386+0000","last_fullsized":"2024-04-25T09:38:57.443386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"84'87","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.892549+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:38:55.892549+0000","last_peered":"2024-04-25T09:38:55.892549+0000","last_clean":"2024-04-25T09:38:55.892549+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:38:55.892549+0000","last_undegraded":"2024-04-25T09:38:55.892549+0000","last_fullsized":"2024-04-25T09:38:55.892549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":322,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.487329+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:38:47.487329+0000","last_peered":"2024-04-25T09:38:47.487329+0000","last_clean":"2024-04-25T09:38:47.487329+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:38:47.487329+0000","last_undegraded":"2024-04-25T09:38:47.487329+0000","last_fullsized":"2024-04-25T09:38:47.487329+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.611356+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:47.611356+0000","last_peered":"2024-04-25T09:38:47.611356+0000","last_clean":"2024-04-25T09:38:47.611356+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:47.611356+0000","last_undegraded":"2024-04-25T09:38:47.611356+0000","last_fullsized":"2024-04-25T09:38:47.611356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"84'87","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.006521+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:38:56.006521+0000","last_peered":"2024-04-25T09:38:56.006521+0000","last_clean":"2024-04-25T09:38:56.006521+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:38:56.006521+0000","last_undegraded":"2024-04-25T09:38:56.006521+0000","last_fullsized":"2024-04-25T09:38:56.006521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.601951+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:38:47.601951+0000","last_peered":"2024-04-25T09:38:47.601951+0000","last_clean":"2024-04-25T09:38:47.601951+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:38:47.601951+0000","last_undegraded":"2024-04-25T09:38:47.601951+0000","last_fullsized":"2024-04-25T09:38:47.601951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"84'112","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.402223+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:38:57.402223+0000","last_peered":"2024-04-25T09:38:57.402223+0000","last_clean":"2024-04-25T09:38:57.402223+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:38:57.402223+0000","last_undegraded":"2024-04-25T09:38:57.402223+0000","last_fullsized":"2024-04-25T09:38:57.402223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.584522+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:47.584522+0000","last_peered":"2024-04-25T09:38:47.584522+0000","last_clean":"2024-04-25T09:38:47.584522+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:47.584522+0000","last_undegraded":"2024-04-25T09:38:47.584522+0000","last_fullsized":"2024-04-25T09:38:47.584522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"84'106","reported_seq":119,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.456690+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:38:57.456690+0000","last_peered":"2024-04-25T09:38:57.456690+0000","last_clean":"2024-04-25T09:38:57.456690+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:38:57.456690+0000","last_undegraded":"2024-04-25T09:38:57.456690+0000","last_fullsized":"2024-04-25T09:38:57.456690+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":876544,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.592331+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:38:47.592331+0000","last_peered":"2024-04-25T09:38:47.592331+0000","last_clean":"2024-04-25T09:38:47.592331+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:38:47.592331+0000","last_undegraded":"2024-04-25T09:38:47.592331+0000","last_fullsized":"2024-04-25T09:38:47.592331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"84'55","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.359514+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:38:55.359514+0000","last_peered":"2024-04-25T09:38:55.359514+0000","last_clean":"2024-04-25T09:38:55.359514+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:38:55.359514+0000","last_undegraded":"2024-04-25T09:38:55.359514+0000","last_fullsized":"2024-04-25T09:38:55.359514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":192,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.402672+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:38:57.402672+0000","last_peered":"2024-04-25T09:38:57.402672+0000","last_clean":"2024-04-25T09:38:57.402672+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:38:57.402672+0000","last_undegraded":"2024-04-25T09:38:57.402672+0000","last_fullsized":"2024-04-25T09:38:57.402672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"84'63","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:56.342822+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:38:56.342822+0000","last_peered":"2024-04-25T09:38:56.342822+0000","last_clean":"2024-04-25T09:38:56.342822+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:38:56.342822+0000","last_undegraded":"2024-04-25T09:38:56.342822+0000","last_fullsized":"2024-04-25T09:38:56.342822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.494614+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:38:47.494614+0000","last_peered":"2024-04-25T09:38:47.494614+0000","last_clean":"2024-04-25T09:38:47.494614+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:38:47.494614+0000","last_undegraded":"2024-04-25T09:38:47.494614+0000","last_fullsized":"2024-04-25T09:38:47.494614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"84'103","reported_seq":116,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:55.538332+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:38:55.538332+0000","last_peered":"2024-04-25T09:38:55.538332+0000","last_clean":"2024-04-25T09:38:55.538332+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:38:55.538332+0000","last_undegraded":"2024-04-25T09:38:55.538332+0000","last_fullsized":"2024-04-25T09:38:55.538332+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":192,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-25T09:38:57.400363+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:38:57.400363+0000","last_peered":"2024-04-25T09:38:57.400363+0000","last_clean":"2024-04-25T09:38:57.400363+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:38:57.400363+0000","last_undegraded":"2024-04-25T09:38:57.400363+0000","last_fullsized":"2024-04-25T09:38:57.400363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"84'55","reported_seq":68,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:54.900836+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:38:54.900836+0000","last_peered":"2024-04-25T09:38:54.900836+0000","last_clean":"2024-04-25T09:38:54.900836+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:38:54.900836+0000","last_undegraded":"2024-04-25T09:38:54.900836+0000","last_fullsized":"2024-04-25T09:38:54.900836+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":185,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:38:47.583008+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:38:47.583008+0000","last_peered":"2024-04-25T09:38:47.583008+0000","last_clean":"2024-04-25T09:38:47.583008+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:38:47.583008+0000","last_undegraded":"2024-04-25T09:38:47.583008+0000","last_fullsized":"2024-04-25T09:38:47.583008+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":11624448,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1419,"num_write_kb":11352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17162240,"data_stored":34324480,"data_compressed":1769040,"data_compressed_allocated":17162240,"data_compressed_original":34324480,"omap_allocated":0,"internal_metadata":0},"log_size":1406,"ondisk_log_size":1406,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116952,"kb_used_data":5456,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94254888,"statfs":{"total":96636764160,"available":96517005312,"internally_reserved":0,"allocated":5586944,"data_stored":10815486,"data_compressed":546763,"data_compressed_allocated":5054464,"data_compressed_original":10600448,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89288,"kb_used_data":4160,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94282552,"statfs":{"total":96636764160,"available":96545333248,"internally_reserved":0,"allocated":4259840,"data_stored":8161278,"data_compressed":409965,"data_compressed_allocated":3727360,"data_compressed_original":7946240,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110792,"kb_used_data":3456,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94261048,"statfs":{"total":96636764160,"available":96523313152,"internally_reserved":0,"allocated":3538944,"data_stored":6251998,"data_compressed":311971,"data_compressed_allocated":3026944,"data_compressed_original":6053888,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706338,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104584,"kb_used_data":5568,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94267256,"statfs":{"total":96636764160,"available":96529670144,"internally_reserved":0,"allocated":5701632,"data_stored":11044862,"data_compressed":558517,"data_compressed_allocated":5169152,"data_compressed_original":10829824,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5206016,"data_stored":10412032,"data_compressed":536587,"data_compressed_allocated":5206016,"data_compressed_original":10412032,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3076096,"data_stored":6152192,"data_compressed":317047,"data_compressed_allocated":3076096,"data_compressed_original":6152192,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3854336,"data_stored":7708672,"data_compressed":397341,"data_compressed_allocated":3854336,"data_compressed_original":7708672,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5025792,"data_stored":10051584,"data_compressed":518065,"data_compressed_allocated":5025792,"data_compressed_original":10051584,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:39:01.225 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:39:01.225 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:01.226 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:39:01.226 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:39:01.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.358+0000 7f2491a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.359 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.369+0000 7f2491a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.394 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:01.395 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:01.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:01.398 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:01.398 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:39:01.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.530+0000 7f6ba6b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.542+0000 7f6ba6b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 2026 2010 1.12155 1.10156 0.1282 0.110854 2024-04-25T09:39:01.587 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:01.587 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:01.587 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:01.587 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:01.587 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:01.588 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:01.588 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:01.588 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:01.588 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:01.588 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:01.588 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:01.588 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:01.590 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:01.591 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:01.591 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:39:01.753 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.755+0000 7fef4e86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.758 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.768+0000 7fef4e86d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.815 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:01.815 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:01.815 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:01.815 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:01.815 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:01.815 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:01.816 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:01.816 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:01.816 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:01.816 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:01.816 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:01.816 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:01.818 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:01.818 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:01.818 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:39:01.923 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:01.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.943+0000 7f2d0199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:01.954+0000 7f2d0199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:01.971 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:01.972 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:01.974 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:01.974 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:02.046 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:02.053+0000 7ff689206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:02.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:02.060+0000 7ff689206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:02.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2169 2153 1.12126 1.11719 0.11505 0.110975 2024-04-25T09:39:03.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2312 2296 1.121 1.11719 0.111298 0.111163 2024-04-25T09:39:04.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:04.368 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:04.375+0000 7f28c935d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:04.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:04.383+0000 7f28c935d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:04.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2465 2449 1.12536 1.19531 0.0978533 0.110482 2024-04-25T09:39:05.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2617 2601 1.12881 1.1875 0.0549664 0.110338 2024-04-25T09:39:06.546 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 2772 2756 1.13312 1.21094 0.0549078 0.109959 2024-04-25T09:39:06.567 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:06.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:06.695+0000 7f8d1782d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:06.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:06.702+0000 7f8d1782d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:06.975 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:06.976 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:06.976 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:39:07.096 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:07.100+0000 7f6747cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:07.101 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:07.110+0000 7f6747cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:07.307 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:39:07.308 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:39:07.328 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":423,"stamp":"2024-04-25T09:39:05.371045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":17719840,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2228,"num_write_kb":18622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2173,"ondisk_log_size":2173,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":438236,"kb_used_data":26940,"kb_used_omap":0,"kb_used_meta":411264,"kb_avail":377049124,"statfs":{"total":386547056640,"available":386098302976,"internally_reserved":0,"allocated":27586560,"data_stored":53101217,"data_compressed":2693943,"data_compressed_allocated":25370624,"data_compressed_original":52215808,"omap_allocated":0,"internal_metadata":421134336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5505024,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.978914"},"pg_stats":[{"pgid":"9.7","version":"87'159","reported_seq":179,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.206094+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:00.206094+0000","last_peered":"2024-04-25T09:39:00.206094+0000","last_clean":"2024-04-25T09:39:00.206094+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:00.206094+0000","last_undegraded":"2024-04-25T09:39:00.206094+0000","last_fullsized":"2024-04-25T09:39:00.206094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"87'135","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.256251+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:01.256251+0000","last_peered":"2024-04-25T09:39:01.256251+0000","last_clean":"2024-04-25T09:39:01.256251+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:01.256251+0000","last_undegraded":"2024-04-25T09:39:01.256251+0000","last_fullsized":"2024-04-25T09:39:01.256251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"87'120","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.414617+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:00.414617+0000","last_peered":"2024-04-25T09:39:00.414617+0000","last_clean":"2024-04-25T09:39:00.414617+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:00.414617+0000","last_undegraded":"2024-04-25T09:39:00.414617+0000","last_fullsized":"2024-04-25T09:39:00.414617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'138","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.466838+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:02.466838+0000","last_peered":"2024-04-25T09:39:02.466838+0000","last_clean":"2024-04-25T09:39:02.466838+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:02.466838+0000","last_undegraded":"2024-04-25T09:39:02.466838+0000","last_fullsized":"2024-04-25T09:39:02.466838+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1138688,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":1112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"87'127","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.714430+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:01.714430+0000","last_peered":"2024-04-25T09:39:01.714430+0000","last_clean":"2024-04-25T09:39:01.714430+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:01.714430+0000","last_undegraded":"2024-04-25T09:39:01.714430+0000","last_fullsized":"2024-04-25T09:39:01.714430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"87'127","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.909248+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:38:59.909248+0000","last_peered":"2024-04-25T09:38:59.909248+0000","last_clean":"2024-04-25T09:38:59.909248+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:38:59.909248+0000","last_undegraded":"2024-04-25T09:38:59.909248+0000","last_fullsized":"2024-04-25T09:38:59.909248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"87'143","reported_seq":163,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.196064+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:01.196064+0000","last_peered":"2024-04-25T09:39:01.196064+0000","last_clean":"2024-04-25T09:39:01.196064+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:01.196064+0000","last_undegraded":"2024-04-25T09:39:01.196064+0000","last_fullsized":"2024-04-25T09:39:01.196064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'103","reported_seq":128,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.281540+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:02.281540+0000","last_peered":"2024-04-25T09:39:02.281540+0000","last_clean":"2024-04-25T09:39:02.281540+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:02.281540+0000","last_undegraded":"2024-04-25T09:39:02.281540+0000","last_fullsized":"2024-04-25T09:39:02.281540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"87'127","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.539164+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:01.539164+0000","last_peered":"2024-04-25T09:39:01.539164+0000","last_clean":"2024-04-25T09:39:01.539164+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:01.539164+0000","last_undegraded":"2024-04-25T09:39:01.539164+0000","last_fullsized":"2024-04-25T09:39:01.539164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":329,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.429330+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:38:59.429330+0000","last_peered":"2024-04-25T09:38:59.429330+0000","last_clean":"2024-04-25T09:38:59.429330+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:38:59.429330+0000","last_undegraded":"2024-04-25T09:38:59.429330+0000","last_fullsized":"2024-04-25T09:38:59.429330+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":194,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.536805+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:38:59.536805+0000","last_peered":"2024-04-25T09:38:59.536805+0000","last_clean":"2024-04-25T09:38:59.536805+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:38:59.536805+0000","last_undegraded":"2024-04-25T09:38:59.536805+0000","last_fullsized":"2024-04-25T09:38:59.536805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"87'119","reported_seq":139,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.422474+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:01.422474+0000","last_peered":"2024-04-25T09:39:01.422474+0000","last_clean":"2024-04-25T09:39:01.422474+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:01.422474+0000","last_undegraded":"2024-04-25T09:39:01.422474+0000","last_fullsized":"2024-04-25T09:39:01.422474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":194,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.511231+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:38:59.511231+0000","last_peered":"2024-04-25T09:38:59.511231+0000","last_clean":"2024-04-25T09:38:59.511231+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:38:59.511231+0000","last_undegraded":"2024-04-25T09:38:59.511231+0000","last_fullsized":"2024-04-25T09:38:59.511231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'167","reported_seq":192,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.368944+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:02.368944+0000","last_peered":"2024-04-25T09:39:02.368944+0000","last_clean":"2024-04-25T09:39:02.368944+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:02.368944+0000","last_undegraded":"2024-04-25T09:39:02.368944+0000","last_fullsized":"2024-04-25T09:39:02.368944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":194,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.511472+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:38:59.511472+0000","last_peered":"2024-04-25T09:38:59.511472+0000","last_clean":"2024-04-25T09:38:59.511472+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:38:59.511472+0000","last_undegraded":"2024-04-25T09:38:59.511472+0000","last_fullsized":"2024-04-25T09:38:59.511472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"87'147","reported_seq":167,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.456333+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:02.456333+0000","last_peered":"2024-04-25T09:39:02.456333+0000","last_clean":"2024-04-25T09:39:02.456333+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:02.456333+0000","last_undegraded":"2024-04-25T09:39:02.456333+0000","last_fullsized":"2024-04-25T09:39:02.456333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1212416,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":148,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":194,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.538205+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:38:59.538205+0000","last_peered":"2024-04-25T09:38:59.538205+0000","last_clean":"2024-04-25T09:38:59.538205+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:38:59.538205+0000","last_undegraded":"2024-04-25T09:38:59.538205+0000","last_fullsized":"2024-04-25T09:38:59.538205+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"87'95","reported_seq":115,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.217737+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:01.217737+0000","last_peered":"2024-04-25T09:39:01.217737+0000","last_clean":"2024-04-25T09:39:01.217737+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:01.217737+0000","last_undegraded":"2024-04-25T09:39:01.217737+0000","last_fullsized":"2024-04-25T09:39:01.217737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"87'129","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.487080+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:01.487080+0000","last_peered":"2024-04-25T09:39:01.487080+0000","last_clean":"2024-04-25T09:39:01.487080+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:01.487080+0000","last_undegraded":"2024-04-25T09:39:01.487080+0000","last_fullsized":"2024-04-25T09:39:01.487080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064960,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":1040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":196,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.438494+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:38:59.438494+0000","last_peered":"2024-04-25T09:38:59.438494+0000","last_clean":"2024-04-25T09:38:59.438494+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:38:59.438494+0000","last_undegraded":"2024-04-25T09:38:59.438494+0000","last_fullsized":"2024-04-25T09:38:59.438494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"87'135","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.937081+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:01.937081+0000","last_peered":"2024-04-25T09:39:01.937081+0000","last_clean":"2024-04-25T09:39:01.937081+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:01.937081+0000","last_undegraded":"2024-04-25T09:39:01.937081+0000","last_fullsized":"2024-04-25T09:39:01.937081+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"87'105","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:39:01.456316+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:01.456316+0000","last_peered":"2024-04-25T09:39:01.456316+0000","last_clean":"2024-04-25T09:39:01.456316+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:01.456316+0000","last_undegraded":"2024-04-25T09:39:01.456316+0000","last_fullsized":"2024-04-25T09:39:01.456316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":868352,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":194,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-25T09:38:59.520495+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:38:59.520495+0000","last_peered":"2024-04-25T09:38:59.520495+0000","last_clean":"2024-04-25T09:38:59.520495+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:38:59.520495+0000","last_undegraded":"2024-04-25T09:38:59.520495+0000","last_fullsized":"2024-04-25T09:38:59.520495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":17129472,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2091,"num_write_kb":16728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25550848,"data_stored":51101696,"data_compressed":2635344,"data_compressed_allocated":25550848,"data_compressed_original":51101696,"omap_allocated":0,"internal_metadata":0},"log_size":2076,"ondisk_log_size":2076,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673639,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":119088,"kb_used_data":7592,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94252752,"statfs":{"total":96636764160,"available":96514818048,"internally_reserved":0,"allocated":7774208,"data_stored":15150597,"data_compressed":770107,"data_compressed_allocated":7217152,"data_compressed_original":14925824,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673639,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95208,"kb_used_data":5920,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94276632,"statfs":{"total":96636764160,"available":96539271168,"internally_reserved":0,"allocated":6062080,"data_stored":11713202,"data_compressed":592701,"data_compressed_allocated":5496832,"data_compressed_original":11485184,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706343,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112764,"kb_used_data":5428,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94259076,"statfs":{"total":96636764160,"available":96521293824,"internally_reserved":0,"allocated":5558272,"data_stored":10251237,"data_compressed":517972,"data_compressed_allocated":5021696,"data_compressed_original":10043392,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706343,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111176,"kb_used_data":8000,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94260664,"statfs":{"total":96636764160,"available":96522919936,"internally_reserved":0,"allocated":8192000,"data_stored":15986181,"data_compressed":813163,"data_compressed_allocated":7634944,"data_compressed_original":15761408,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7667712,"data_stored":15335424,"data_compressed":790810,"data_compressed_allocated":7667712,"data_compressed_original":15335424,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5074944,"data_stored":10149888,"data_compressed":523471,"data_compressed_allocated":5074944,"data_compressed_original":10149888,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5566464,"data_stored":11132928,"data_compressed":574155,"data_compressed_allocated":5566464,"data_compressed_original":11132928,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7241728,"data_stored":14483456,"data_compressed":746908,"data_compressed_allocated":7241728,"data_compressed_original":14483456,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:39:07.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:39:07.557101+0000 min lat: 0.0148973 max lat: 0.425634 avg lat: 0.110604 2024-04-25T09:39:07.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:39:07.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 2896 2880 1.1249 0.96875 0.156581 0.110604 2024-04-25T09:39:08.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 3040 3024 1.1249 1.125 0.0760675 0.110803 2024-04-25T09:39:08.923 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:09.050 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:09.057+0000 7efeef46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:09.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:09.065+0000 7efeef46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:09.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 3188 3172 1.12632 1.15625 0.0897322 0.110703 2024-04-25T09:39:10.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3329 3313 1.12524 1.10156 0.145133 0.110666 2024-04-25T09:39:11.213 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:11.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:11.345+0000 7f4b5595d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:11.343 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:11.352+0000 7f4b5595d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:11.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3469 3453 1.12392 1.09375 0.112776 0.11083 2024-04-25T09:39:12.330 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:12.330 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:12.330 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:39:12.498 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:12.502+0000 7f3f4ed5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:12.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:12.513+0000 7f3f4ed5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:12.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 3612 3596 1.12365 1.11719 0.164505 0.110886 2024-04-25T09:39:12.880 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:39:12.880 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:39:12.900 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":426,"stamp":"2024-04-25T09:39:11.372279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23831072,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2974,"num_write_kb":24590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2918,"ondisk_log_size":2918,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":438928,"kb_used_data":35952,"kb_used_omap":0,"kb_used_meta":402944,"kb_avail":377048432,"statfs":{"total":386547056640,"available":386097594368,"internally_reserved":0,"allocated":36814848,"data_stored":71518376,"data_compressed":3644424,"data_compressed_allocated":34574336,"data_compressed_original":70623232,"omap_allocated":0,"internal_metadata":412614656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11616256,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1418,"num_write_kb":11344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.970027"},"pg_stats":[{"pgid":"9.7","version":"88'183","reported_seq":206,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:05.555732+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:05.555732+0000","last_peered":"2024-04-25T09:39:05.555732+0000","last_clean":"2024-04-25T09:39:05.555732+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:05.555732+0000","last_undegraded":"2024-04-25T09:39:05.555732+0000","last_fullsized":"2024-04-25T09:39:05.555732+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"88'175","reported_seq":200,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:05.799100+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:05.799100+0000","last_peered":"2024-04-25T09:39:05.799100+0000","last_clean":"2024-04-25T09:39:05.799100+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:05.799100+0000","last_undegraded":"2024-04-25T09:39:05.799100+0000","last_fullsized":"2024-04-25T09:39:05.799100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"88'143","reported_seq":168,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:07.430508+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:07.430508+0000","last_peered":"2024-04-25T09:39:07.430508+0000","last_clean":"2024-04-25T09:39:07.430508+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:07.430508+0000","last_undegraded":"2024-04-25T09:39:07.430508+0000","last_fullsized":"2024-04-25T09:39:07.430508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'191","reported_seq":216,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:06.756402+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:06.756402+0000","last_peered":"2024-04-25T09:39:06.756402+0000","last_clean":"2024-04-25T09:39:06.756402+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:06.756402+0000","last_undegraded":"2024-04-25T09:39:06.756402+0000","last_fullsized":"2024-04-25T09:39:06.756402+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"88'191","reported_seq":214,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:06.925460+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:06.925460+0000","last_peered":"2024-04-25T09:39:06.925460+0000","last_clean":"2024-04-25T09:39:06.925460+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:06.925460+0000","last_undegraded":"2024-04-25T09:39:06.925460+0000","last_fullsized":"2024-04-25T09:39:06.925460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"88'191","reported_seq":216,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:06.340124+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:39:06.340124+0000","last_peered":"2024-04-25T09:39:06.340124+0000","last_clean":"2024-04-25T09:39:06.340124+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:39:06.340124+0000","last_undegraded":"2024-04-25T09:39:06.340124+0000","last_fullsized":"2024-04-25T09:39:06.340124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"88'183","reported_seq":206,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:06.505352+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:06.505352+0000","last_peered":"2024-04-25T09:39:06.505352+0000","last_clean":"2024-04-25T09:39:06.505352+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:06.505352+0000","last_undegraded":"2024-04-25T09:39:06.505352+0000","last_fullsized":"2024-04-25T09:39:06.505352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'175","reported_seq":200,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:07.359419+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:07.359419+0000","last_peered":"2024-04-25T09:39:07.359419+0000","last_clean":"2024-04-25T09:39:07.359419+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:07.359419+0000","last_undegraded":"2024-04-25T09:39:07.359419+0000","last_fullsized":"2024-04-25T09:39:07.359419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"88'175","reported_seq":198,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:06.508888+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:06.508888+0000","last_peered":"2024-04-25T09:39:06.508888+0000","last_clean":"2024-04-25T09:39:06.508888+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:06.508888+0000","last_undegraded":"2024-04-25T09:39:06.508888+0000","last_fullsized":"2024-04-25T09:39:06.508888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":332,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.622668+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:39:02.622668+0000","last_peered":"2024-04-25T09:39:02.622668+0000","last_clean":"2024-04-25T09:39:02.622668+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:39:02.622668+0000","last_undegraded":"2024-04-25T09:39:02.622668+0000","last_fullsized":"2024-04-25T09:39:02.622668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.694171+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:02.694171+0000","last_peered":"2024-04-25T09:39:02.694171+0000","last_clean":"2024-04-25T09:39:02.694171+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:02.694171+0000","last_undegraded":"2024-04-25T09:39:02.694171+0000","last_fullsized":"2024-04-25T09:39:02.694171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'175","reported_seq":198,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:05.468140+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:05.468140+0000","last_peered":"2024-04-25T09:39:05.468140+0000","last_clean":"2024-04-25T09:39:05.468140+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:05.468140+0000","last_undegraded":"2024-04-25T09:39:05.468140+0000","last_fullsized":"2024-04-25T09:39:05.468140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639404+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:02.639404+0000","last_peered":"2024-04-25T09:39:02.639404+0000","last_clean":"2024-04-25T09:39:02.639404+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:02.639404+0000","last_undegraded":"2024-04-25T09:39:02.639404+0000","last_fullsized":"2024-04-25T09:39:02.639404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'252","reported_seq":277,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:07.484409+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:07.484409+0000","last_peered":"2024-04-25T09:39:07.484409+0000","last_clean":"2024-04-25T09:39:07.484409+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:07.484409+0000","last_undegraded":"2024-04-25T09:39:07.484409+0000","last_fullsized":"2024-04-25T09:39:07.484409+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2072576,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":253,"num_write_kb":2024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.677609+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:02.677609+0000","last_peered":"2024-04-25T09:39:02.677609+0000","last_clean":"2024-04-25T09:39:02.677609+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:02.677609+0000","last_undegraded":"2024-04-25T09:39:02.677609+0000","last_fullsized":"2024-04-25T09:39:02.677609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"88'191","reported_seq":214,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:06.973802+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:06.973802+0000","last_peered":"2024-04-25T09:39:06.973802+0000","last_clean":"2024-04-25T09:39:06.973802+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:06.973802+0000","last_undegraded":"2024-04-25T09:39:06.973802+0000","last_fullsized":"2024-04-25T09:39:06.973802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.643068+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:02.643068+0000","last_peered":"2024-04-25T09:39:02.643068+0000","last_clean":"2024-04-25T09:39:02.643068+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:02.643068+0000","last_undegraded":"2024-04-25T09:39:02.643068+0000","last_fullsized":"2024-04-25T09:39:02.643068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"88'111","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:05.921561+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:05.921561+0000","last_peered":"2024-04-25T09:39:05.921561+0000","last_clean":"2024-04-25T09:39:05.921561+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:05.921561+0000","last_undegraded":"2024-04-25T09:39:05.921561+0000","last_fullsized":"2024-04-25T09:39:05.921561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"88'167","reported_seq":190,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:05.729214+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:05.729214+0000","last_peered":"2024-04-25T09:39:05.729214+0000","last_clean":"2024-04-25T09:39:05.729214+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:05.729214+0000","last_undegraded":"2024-04-25T09:39:05.729214+0000","last_fullsized":"2024-04-25T09:39:05.729214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639997+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:39:02.639997+0000","last_peered":"2024-04-25T09:39:02.639997+0000","last_clean":"2024-04-25T09:39:02.639997+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:39:02.639997+0000","last_undegraded":"2024-04-25T09:39:02.639997+0000","last_fullsized":"2024-04-25T09:39:02.639997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"88'151","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:04.375531+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:04.375531+0000","last_peered":"2024-04-25T09:39:04.375531+0000","last_clean":"2024-04-25T09:39:04.375531+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:04.375531+0000","last_undegraded":"2024-04-25T09:39:04.375531+0000","last_fullsized":"2024-04-25T09:39:04.375531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"88'167","reported_seq":192,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:05.895032+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:05.895032+0000","last_peered":"2024-04-25T09:39:05.895032+0000","last_clean":"2024-04-25T09:39:05.895032+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:05.895032+0000","last_undegraded":"2024-04-25T09:39:05.895032+0000","last_fullsized":"2024-04-25T09:39:05.895032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.693995+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:02.693995+0000","last_peered":"2024-04-25T09:39:02.693995+0000","last_clean":"2024-04-25T09:39:02.693995+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:02.693995+0000","last_undegraded":"2024-04-25T09:39:02.693995+0000","last_fullsized":"2024-04-25T09:39:02.693995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":23240704,"num_objects":355,"num_object_clones":0,"num_object_copies":1065,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2837,"num_write_kb":22696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34705408,"data_stored":69410816,"data_compressed":3580749,"data_compressed_allocated":34705408,"data_compressed_original":69410816,"omap_allocated":0,"internal_metadata":0},"log_size":2821,"ondisk_log_size":2821,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108944,"kb_used_data":9928,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94262896,"statfs":{"total":96636764160,"available":96525205504,"internally_reserved":0,"allocated":10166272,"data_stored":19921586,"data_compressed":1016293,"data_compressed_allocated":9601024,"data_compressed_original":19693568,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97188,"kb_used_data":7900,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94274652,"statfs":{"total":96636764160,"available":96537243648,"internally_reserved":0,"allocated":8089600,"data_stored":15768242,"data_compressed":802086,"data_compressed_allocated":7524352,"data_compressed_original":15540224,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114628,"kb_used_data":7292,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94257212,"statfs":{"total":96636764160,"available":96519385088,"internally_reserved":0,"allocated":7467008,"data_stored":14055570,"data_compressed":714244,"data_compressed_allocated":6922240,"data_compressed_original":13844480,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706348,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118168,"kb_used_data":10832,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94253672,"statfs":{"total":96636764160,"available":96515760128,"internally_reserved":0,"allocated":11091968,"data_stored":21772978,"data_compressed":1111801,"data_compressed_allocated":10526720,"data_compressed_original":21544960,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10563584,"data_stored":21127168,"data_compressed":1089871,"data_compressed_allocated":10563584,"data_compressed_original":21127168,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6963200,"data_stored":13926400,"data_compressed":718474,"data_compressed_allocated":6963200,"data_compressed_original":13926400,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7589888,"data_stored":15179776,"data_compressed":783117,"data_compressed_allocated":7589888,"data_compressed_original":15179776,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9588736,"data_stored":19177472,"data_compressed":989287,"data_compressed_allocated":9588736,"data_compressed_original":19177472,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:39:13.495 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:13.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 3740 3724 1.11889 1 0.0655851 0.111414 2024-04-25T09:39:13.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:13.666+0000 7faff840f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:13.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:13.673+0000 7faff840f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:14.547 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 3883 3867 1.11882 1.11719 0.136456 0.11145 2024-04-25T09:39:15.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 4024 4008 1.1182 1.10156 0.0469653 0.111384 2024-04-25T09:39:15.806 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:15.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:15.960+0000 7fbcb8b54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:15.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:15.968+0000 7fbcb8b54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:16.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 4159 4143 1.11601 1.05469 0.0838508 0.111698 2024-04-25T09:39:17.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4314 4298 1.11917 1.21094 0.0612494 0.11142 2024-04-25T09:39:17.902 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:17.902 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:17.902 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:39:17.903 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:39:18.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.032+0000 7fb03619d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.035 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.045+0000 7fb03619d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.082 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:18.083 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:18.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:18.086 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:18.086 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:39:18.117 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:18.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.240+0000 7f617a95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.243 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.252+0000 7f617a95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.267 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:18.267 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:18.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.274+0000 7fb04e4ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.271 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:18.272 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:18.272 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:39:18.273 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.281+0000 7fb04e4ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.425 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.426+0000 7fedd9aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.430 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.439+0000 7fedd9aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.453 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:18.453 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:18.453 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:18.453 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:18.454 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:18.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:18.457 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:18.457 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:39:18.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4455 4439 1.1186 1.10156 0.0436319 0.111457 2024-04-25T09:39:18.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.589+0000 7f0d184ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.591 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:18.600+0000 7f0d184ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:18.621 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:18.621 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:18.621 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:18.621 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:18.622 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:18.625 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:18.625 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:19.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 4597 4581 1.1183 1.10938 0.103164 0.11155 2024-04-25T09:39:20.481 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:20.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 4740 4724 1.11827 1.11719 0.0879053 0.111564 2024-04-25T09:39:20.604 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:20.610+0000 7fea818ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:20.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:20.616+0000 7fea818ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:21.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 4867 4851 1.11456 0.992188 0.124588 0.111943 2024-04-25T09:39:22.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 5017 5001 1.11619 1.17188 0.114511 0.111779 2024-04-25T09:39:22.779 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:22.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:22.914+0000 7ff8d5e24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:22.912 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:22.921+0000 7ff8d5e24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:23.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 5149 5133 1.11383 1.03125 0.160796 0.112022 2024-04-25T09:39:23.626 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:23.626 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:23.627 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:39:23.754 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:23.758+0000 7f7c0e2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:23.759 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:23.768+0000 7f7c0e2ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:23.980 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:39:23.980 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:39:23.994 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2024-04-25T09:39:23.375036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":40976928,"num_objects":619,"num_object_clones":0,"num_object_copies":1857,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5067,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5011,"ondisk_log_size":5011,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":490452,"kb_used_data":61100,"kb_used_omap":0,"kb_used_meta":429312,"kb_avail":376996908,"statfs":{"total":386547056640,"available":386044833792,"internally_reserved":0,"allocated":62566400,"data_stored":123021480,"data_compressed":6303825,"data_compressed_allocated":60325888,"data_compressed_original":122126336,"omap_allocated":0,"internal_metadata":439615488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17145856,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2093,"num_write_kb":16744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002757"},"pg_stats":[{"pgid":"9.7","version":"88'359","reported_seq":382,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.256152+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:21.256152+0000","last_peered":"2024-04-25T09:39:21.256152+0000","last_clean":"2024-04-25T09:39:21.256152+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:21.256152+0000","last_undegraded":"2024-04-25T09:39:21.256152+0000","last_fullsized":"2024-04-25T09:39:21.256152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"88'327","reported_seq":352,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.264994+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:21.264994+0000","last_peered":"2024-04-25T09:39:21.264994+0000","last_clean":"2024-04-25T09:39:21.264994+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:21.264994+0000","last_undegraded":"2024-04-25T09:39:21.264994+0000","last_fullsized":"2024-04-25T09:39:21.264994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"88'263","reported_seq":288,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.730999+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:21.730999+0000","last_peered":"2024-04-25T09:39:21.730999+0000","last_clean":"2024-04-25T09:39:21.730999+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:21.730999+0000","last_undegraded":"2024-04-25T09:39:21.730999+0000","last_fullsized":"2024-04-25T09:39:21.730999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'311","reported_seq":336,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:22.219420+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:22.219420+0000","last_peered":"2024-04-25T09:39:22.219420+0000","last_clean":"2024-04-25T09:39:22.219420+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:22.219420+0000","last_undegraded":"2024-04-25T09:39:22.219420+0000","last_fullsized":"2024-04-25T09:39:22.219420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":311,"log_dups_size":0,"ondisk_log_size":311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"88'351","reported_seq":374,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:20.547750+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:20.547750+0000","last_peered":"2024-04-25T09:39:20.547750+0000","last_clean":"2024-04-25T09:39:20.547750+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:20.547750+0000","last_undegraded":"2024-04-25T09:39:20.547750+0000","last_fullsized":"2024-04-25T09:39:20.547750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"88'343","reported_seq":368,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:20.991762+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:39:20.991762+0000","last_peered":"2024-04-25T09:39:20.991762+0000","last_clean":"2024-04-25T09:39:20.991762+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:39:20.991762+0000","last_undegraded":"2024-04-25T09:39:20.991762+0000","last_fullsized":"2024-04-25T09:39:20.991762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"88'335","reported_seq":358,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.493068+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:21.493068+0000","last_peered":"2024-04-25T09:39:21.493068+0000","last_clean":"2024-04-25T09:39:21.493068+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:21.493068+0000","last_undegraded":"2024-04-25T09:39:21.493068+0000","last_fullsized":"2024-04-25T09:39:21.493068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'303","reported_seq":328,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:22.303208+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:22.303208+0000","last_peered":"2024-04-25T09:39:22.303208+0000","last_clean":"2024-04-25T09:39:22.303208+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:22.303208+0000","last_undegraded":"2024-04-25T09:39:22.303208+0000","last_fullsized":"2024-04-25T09:39:22.303208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"88'319","reported_seq":342,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.454889+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:21.454889+0000","last_peered":"2024-04-25T09:39:21.454889+0000","last_clean":"2024-04-25T09:39:21.454889+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:21.454889+0000","last_undegraded":"2024-04-25T09:39:21.454889+0000","last_fullsized":"2024-04-25T09:39:21.454889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":332,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.622668+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:39:02.622668+0000","last_peered":"2024-04-25T09:39:02.622668+0000","last_clean":"2024-04-25T09:39:02.622668+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:39:02.622668+0000","last_undegraded":"2024-04-25T09:39:02.622668+0000","last_fullsized":"2024-04-25T09:39:02.622668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.694171+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:02.694171+0000","last_peered":"2024-04-25T09:39:02.694171+0000","last_clean":"2024-04-25T09:39:02.694171+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:02.694171+0000","last_undegraded":"2024-04-25T09:39:02.694171+0000","last_fullsized":"2024-04-25T09:39:02.694171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'295","reported_seq":318,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.383090+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:21.383090+0000","last_peered":"2024-04-25T09:39:21.383090+0000","last_clean":"2024-04-25T09:39:21.383090+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:21.383090+0000","last_undegraded":"2024-04-25T09:39:21.383090+0000","last_fullsized":"2024-04-25T09:39:21.383090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639404+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:02.639404+0000","last_peered":"2024-04-25T09:39:02.639404+0000","last_clean":"2024-04-25T09:39:02.639404+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:02.639404+0000","last_undegraded":"2024-04-25T09:39:02.639404+0000","last_fullsized":"2024-04-25T09:39:02.639404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'383","reported_seq":408,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.899072+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:21.899072+0000","last_peered":"2024-04-25T09:39:21.899072+0000","last_clean":"2024-04-25T09:39:21.899072+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:21.899072+0000","last_undegraded":"2024-04-25T09:39:21.899072+0000","last_fullsized":"2024-04-25T09:39:21.899072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.677609+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:02.677609+0000","last_peered":"2024-04-25T09:39:02.677609+0000","last_clean":"2024-04-25T09:39:02.677609+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:02.677609+0000","last_undegraded":"2024-04-25T09:39:02.677609+0000","last_fullsized":"2024-04-25T09:39:02.677609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"88'303","reported_seq":326,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:22.329424+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:22.329424+0000","last_peered":"2024-04-25T09:39:22.329424+0000","last_clean":"2024-04-25T09:39:22.329424+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:22.329424+0000","last_undegraded":"2024-04-25T09:39:22.329424+0000","last_fullsized":"2024-04-25T09:39:22.329424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.643068+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:02.643068+0000","last_peered":"2024-04-25T09:39:02.643068+0000","last_clean":"2024-04-25T09:39:02.643068+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:02.643068+0000","last_undegraded":"2024-04-25T09:39:02.643068+0000","last_fullsized":"2024-04-25T09:39:02.643068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"88'217","reported_seq":240,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.496149+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:21.496149+0000","last_peered":"2024-04-25T09:39:21.496149+0000","last_clean":"2024-04-25T09:39:21.496149+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:21.496149+0000","last_undegraded":"2024-04-25T09:39:21.496149+0000","last_fullsized":"2024-04-25T09:39:21.496149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1785856,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":218,"num_write_kb":1744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"88'279","reported_seq":302,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.180191+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:21.180191+0000","last_peered":"2024-04-25T09:39:21.180191+0000","last_clean":"2024-04-25T09:39:21.180191+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:21.180191+0000","last_undegraded":"2024-04-25T09:39:21.180191+0000","last_fullsized":"2024-04-25T09:39:21.180191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639997+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:39:02.639997+0000","last_peered":"2024-04-25T09:39:02.639997+0000","last_clean":"2024-04-25T09:39:02.639997+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:39:02.639997+0000","last_undegraded":"2024-04-25T09:39:02.639997+0000","last_fullsized":"2024-04-25T09:39:02.639997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"88'263","reported_seq":286,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:22.038460+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:22.038460+0000","last_peered":"2024-04-25T09:39:22.038460+0000","last_clean":"2024-04-25T09:39:22.038460+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:22.038460+0000","last_undegraded":"2024-04-25T09:39:22.038460+0000","last_fullsized":"2024-04-25T09:39:22.038460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"88'263","reported_seq":288,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:21.110291+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:21.110291+0000","last_peered":"2024-04-25T09:39:21.110291+0000","last_clean":"2024-04-25T09:39:21.110291+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:21.110291+0000","last_undegraded":"2024-04-25T09:39:21.110291+0000","last_fullsized":"2024-04-25T09:39:21.110291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.693995+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:02.693995+0000","last_peered":"2024-04-25T09:39:02.693995+0000","last_clean":"2024-04-25T09:39:02.693995+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:02.693995+0000","last_undegraded":"2024-04-25T09:39:02.693995+0000","last_fullsized":"2024-04-25T09:39:02.693995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":40386560,"num_objects":617,"num_object_clones":0,"num_object_copies":1851,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4930,"num_write_kb":39440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":60436480,"data_stored":120872960,"data_compressed":6238035,"data_compressed_allocated":60436480,"data_compressed_original":120872960,"omap_allocated":0,"internal_metadata":0},"log_size":4914,"ondisk_log_size":4914,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124092,"kb_used_data":16756,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94247748,"statfs":{"total":96636764160,"available":96509693952,"internally_reserved":0,"allocated":17158144,"data_stored":33905330,"data_compressed":1738354,"data_compressed_allocated":16592896,"data_compressed_original":33677312,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124632,"kb_used_data":13132,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94247208,"statfs":{"total":96636764160,"available":96509140992,"internally_reserved":0,"allocated":13447168,"data_stored":26483378,"data_compressed":1355370,"data_compressed_allocated":12881920,"data_compressed_original":26255360,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706363,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111604,"kb_used_data":12588,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94260236,"statfs":{"total":96636764160,"available":96522481664,"internally_reserved":0,"allocated":12890112,"data_stored":24901778,"data_compressed":1274296,"data_compressed_allocated":12345344,"data_compressed_original":24690688,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706363,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130124,"kb_used_data":18624,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94241716,"statfs":{"total":96636764160,"available":96503517184,"internally_reserved":0,"allocated":19070976,"data_stored":37730994,"data_compressed":1935805,"data_compressed_allocated":18505728,"data_compressed_original":37502976,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18522112,"data_stored":37044224,"data_compressed":1911760,"data_compressed_allocated":18522112,"data_compressed_original":37044224,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12382208,"data_stored":24764416,"data_compressed":1278103,"data_compressed_allocated":12382208,"data_compressed_original":24764416,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12955648,"data_stored":25911296,"data_compressed":1337247,"data_compressed_allocated":12955648,"data_compressed_original":25911296,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16576512,"data_stored":33153024,"data_compressed":1710925,"data_compressed_allocated":16576512,"data_compressed_original":33153024,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:39:24.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5287 5271 1.11286 1.07812 0.0384808 0.112066 2024-04-25T09:39:25.117 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:25.231 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:25.238+0000 7f12ec6ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:25.236 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:25.244+0000 7f12ec6ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:25.548 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5420 5404 1.11092 1.03906 0.0837927 0.112345 2024-04-25T09:39:26.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 5562 5546 1.11087 1.10938 0.127263 0.112278 2024-04-25T09:39:27.447 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:27.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:39:27.559050+0000 min lat: 0.0148973 max lat: 0.425634 avg lat: 0.112515 2024-04-25T09:39:27.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:39:27.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 5696 5680 1.10927 1.04688 0.262901 0.112515 2024-04-25T09:39:27.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:27.576+0000 7f9fdccad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:27.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:27.582+0000 7f9fdccad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:28.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 5832 5816 1.10813 1.0625 0.0554349 0.112563 2024-04-25T09:39:28.996 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:28.996 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:28.996 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:39:28.996 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:39:29.123 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.124+0000 7f37fd79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.136+0000 7f37fd79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:29.151 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:29.153 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:29.154 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:29.154 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:29.154 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:39:29.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.288+0000 7f077002d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.302+0000 7f077002d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.321 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:29.322 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:29.324 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:29.325 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:29.325 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:39:29.466 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.468+0000 7f528ee2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.480+0000 7f528ee2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.493 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:29.493 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:29.493 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:29.493 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:29.493 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:29.493 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:29.493 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:29.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:29.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:29.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:29.494 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:29.494 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:29.496 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:29.496 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:29.496 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:39:29.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 5965 5949 1.10648 1.03906 0.158767 0.112764 2024-04-25T09:39:29.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.629+0000 7f5ecb46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.630 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.639+0000 7f5ecb46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.699 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:29.700 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:29.704 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:29.704 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:29.764 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:29.919 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.925+0000 7f526bead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:29.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:29.932+0000 7f526bead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:30.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 6100 6084 1.10527 1.05469 0.0622867 0.112913 2024-04-25T09:39:31.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 6238 6222 1.10465 1.07812 0.0251781 0.113006 2024-04-25T09:39:32.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:32.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:32.287+0000 7fc19c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:32.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:32.294+0000 7fc19c79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:32.549 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 6379 6363 1.10458 1.10156 0.0427907 0.112936 2024-04-25T09:39:33.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 6513 6497 1.10333 1.04688 0.0887351 0.113145 2024-04-25T09:39:34.492 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:34.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 6643 6627 1.10146 1.01562 0.174669 0.113282 2024-04-25T09:39:34.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:34.623+0000 7f20bb59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:34.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:34.630+0000 7f20bb59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:34.706 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:34.706 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:34.706 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:39:34.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:34.843+0000 7f602e6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:34.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:34.853+0000 7f602e6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:35.139 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:39:35.139 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:39:35.159 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2024-04-25T09:39:33.377488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":52298272,"num_objects":792,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":6449,"num_write_kb":52390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6393,"ondisk_log_size":6393,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":494484,"kb_used_data":77612,"kb_used_omap":0,"kb_used_meta":416832,"kb_avail":376992876,"statfs":{"total":386547056640,"available":386040705024,"internally_reserved":0,"allocated":79474688,"data_stored":156838056,"data_compressed":8049969,"data_compressed_allocated":77234176,"data_compressed_original":155942912,"omap_allocated":0,"internal_metadata":426835968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17104896,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2088,"num_write_kb":16704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002879"},"pg_stats":[{"pgid":"9.7","version":"88'429","reported_seq":452,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:31.491060+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:31.491060+0000","last_peered":"2024-04-25T09:39:31.491060+0000","last_clean":"2024-04-25T09:39:31.491060+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:31.491060+0000","last_undegraded":"2024-04-25T09:39:31.491060+0000","last_fullsized":"2024-04-25T09:39:31.491060+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3522560,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":430,"num_write_kb":3440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"88'415","reported_seq":440,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:28.281520+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:28.281520+0000","last_peered":"2024-04-25T09:39:28.281520+0000","last_clean":"2024-04-25T09:39:28.281520+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:28.281520+0000","last_undegraded":"2024-04-25T09:39:28.281520+0000","last_fullsized":"2024-04-25T09:39:28.281520+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"88'359","reported_seq":384,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:32.224346+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:32.224346+0000","last_peered":"2024-04-25T09:39:32.224346+0000","last_clean":"2024-04-25T09:39:32.224346+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:32.224346+0000","last_undegraded":"2024-04-25T09:39:32.224346+0000","last_fullsized":"2024-04-25T09:39:32.224346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'423","reported_seq":448,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:32.120111+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:32.120111+0000","last_peered":"2024-04-25T09:39:32.120111+0000","last_clean":"2024-04-25T09:39:32.120111+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:32.120111+0000","last_undegraded":"2024-04-25T09:39:32.120111+0000","last_fullsized":"2024-04-25T09:39:32.120111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"88'431","reported_seq":454,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:32.318849+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:32.318849+0000","last_peered":"2024-04-25T09:39:32.318849+0000","last_clean":"2024-04-25T09:39:32.318849+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:32.318849+0000","last_undegraded":"2024-04-25T09:39:32.318849+0000","last_fullsized":"2024-04-25T09:39:32.318849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"88'455","reported_seq":480,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:31.465526+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:39:31.465526+0000","last_peered":"2024-04-25T09:39:31.465526+0000","last_clean":"2024-04-25T09:39:31.465526+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:39:31.465526+0000","last_undegraded":"2024-04-25T09:39:31.465526+0000","last_fullsized":"2024-04-25T09:39:31.465526+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"88'423","reported_seq":446,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:31.382040+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:31.382040+0000","last_peered":"2024-04-25T09:39:31.382040+0000","last_clean":"2024-04-25T09:39:31.382040+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:31.382040+0000","last_undegraded":"2024-04-25T09:39:31.382040+0000","last_fullsized":"2024-04-25T09:39:31.382040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'351","reported_seq":376,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:32.453907+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:32.453907+0000","last_peered":"2024-04-25T09:39:32.453907+0000","last_clean":"2024-04-25T09:39:32.453907+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:32.453907+0000","last_undegraded":"2024-04-25T09:39:32.453907+0000","last_fullsized":"2024-04-25T09:39:32.453907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"88'415","reported_seq":438,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:32.349784+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:32.349784+0000","last_peered":"2024-04-25T09:39:32.349784+0000","last_clean":"2024-04-25T09:39:32.349784+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:32.349784+0000","last_undegraded":"2024-04-25T09:39:32.349784+0000","last_fullsized":"2024-04-25T09:39:32.349784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":332,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.622668+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:39:02.622668+0000","last_peered":"2024-04-25T09:39:02.622668+0000","last_clean":"2024-04-25T09:39:02.622668+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:39:02.622668+0000","last_undegraded":"2024-04-25T09:39:02.622668+0000","last_fullsized":"2024-04-25T09:39:02.622668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.694171+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:02.694171+0000","last_peered":"2024-04-25T09:39:02.694171+0000","last_clean":"2024-04-25T09:39:02.694171+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:02.694171+0000","last_undegraded":"2024-04-25T09:39:02.694171+0000","last_fullsized":"2024-04-25T09:39:02.694171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'367","reported_seq":390,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:31.061973+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:31.061973+0000","last_peered":"2024-04-25T09:39:31.061973+0000","last_clean":"2024-04-25T09:39:31.061973+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:31.061973+0000","last_undegraded":"2024-04-25T09:39:31.061973+0000","last_fullsized":"2024-04-25T09:39:31.061973+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639404+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:02.639404+0000","last_peered":"2024-04-25T09:39:02.639404+0000","last_clean":"2024-04-25T09:39:02.639404+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:02.639404+0000","last_undegraded":"2024-04-25T09:39:02.639404+0000","last_fullsized":"2024-04-25T09:39:02.639404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'471","reported_seq":496,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:31.932856+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:31.932856+0000","last_peered":"2024-04-25T09:39:31.932856+0000","last_clean":"2024-04-25T09:39:31.932856+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:31.932856+0000","last_undegraded":"2024-04-25T09:39:31.932856+0000","last_fullsized":"2024-04-25T09:39:31.932856+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.677609+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:02.677609+0000","last_peered":"2024-04-25T09:39:02.677609+0000","last_clean":"2024-04-25T09:39:02.677609+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:02.677609+0000","last_undegraded":"2024-04-25T09:39:02.677609+0000","last_fullsized":"2024-04-25T09:39:02.677609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"88'367","reported_seq":390,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:28.181777+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:28.181777+0000","last_peered":"2024-04-25T09:39:28.181777+0000","last_clean":"2024-04-25T09:39:28.181777+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:28.181777+0000","last_undegraded":"2024-04-25T09:39:28.181777+0000","last_fullsized":"2024-04-25T09:39:28.181777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.643068+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:02.643068+0000","last_peered":"2024-04-25T09:39:02.643068+0000","last_clean":"2024-04-25T09:39:02.643068+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:02.643068+0000","last_undegraded":"2024-04-25T09:39:02.643068+0000","last_fullsized":"2024-04-25T09:39:02.643068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"88'279","reported_seq":302,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:30.182071+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:30.182071+0000","last_peered":"2024-04-25T09:39:30.182071+0000","last_clean":"2024-04-25T09:39:30.182071+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:30.182071+0000","last_undegraded":"2024-04-25T09:39:30.182071+0000","last_fullsized":"2024-04-25T09:39:30.182071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"88'359","reported_seq":382,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:31.124512+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:31.124512+0000","last_peered":"2024-04-25T09:39:31.124512+0000","last_clean":"2024-04-25T09:39:31.124512+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:31.124512+0000","last_undegraded":"2024-04-25T09:39:31.124512+0000","last_fullsized":"2024-04-25T09:39:31.124512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639997+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:39:02.639997+0000","last_peered":"2024-04-25T09:39:02.639997+0000","last_clean":"2024-04-25T09:39:02.639997+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:39:02.639997+0000","last_undegraded":"2024-04-25T09:39:02.639997+0000","last_fullsized":"2024-04-25T09:39:02.639997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"88'393","reported_seq":416,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:32.478430+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:32.478430+0000","last_peered":"2024-04-25T09:39:32.478430+0000","last_clean":"2024-04-25T09:39:32.478430+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:32.478430+0000","last_undegraded":"2024-04-25T09:39:32.478430+0000","last_fullsized":"2024-04-25T09:39:32.478430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3227648,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":394,"num_write_kb":3152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"88'359","reported_seq":384,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:30.989638+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:30.989638+0000","last_peered":"2024-04-25T09:39:30.989638+0000","last_clean":"2024-04-25T09:39:30.989638+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:30.989638+0000","last_undegraded":"2024-04-25T09:39:30.989638+0000","last_fullsized":"2024-04-25T09:39:30.989638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.693995+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:02.693995+0000","last_peered":"2024-04-25T09:39:02.693995+0000","last_clean":"2024-04-25T09:39:02.693995+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:02.693995+0000","last_undegraded":"2024-04-25T09:39:02.693995+0000","last_fullsized":"2024-04-25T09:39:02.693995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":51707904,"num_objects":790,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6312,"num_write_kb":50496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77328384,"data_stored":154656768,"data_compressed":7982487,"data_compressed_allocated":77328384,"data_compressed_original":154656768,"omap_allocated":0,"internal_metadata":0},"log_size":6296,"ondisk_log_size":6296,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132836,"kb_used_data":21340,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94239004,"statfs":{"total":96636764160,"available":96500740096,"internally_reserved":0,"allocated":21852160,"data_stored":43293362,"data_compressed":2223112,"data_compressed_allocated":21286912,"data_compressed_original":43065344,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115708,"kb_used_data":16688,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94256132,"statfs":{"total":96636764160,"available":96518279168,"internally_reserved":0,"allocated":17088512,"data_stored":33766066,"data_compressed":1731417,"data_compressed_allocated":16523264,"data_compressed_original":33538048,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118996,"kb_used_data":15820,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94252844,"statfs":{"total":96636764160,"available":96514912256,"internally_reserved":0,"allocated":16199680,"data_stored":31520914,"data_compressed":1616080,"data_compressed_allocated":15654912,"data_compressed_original":31309824,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126944,"kb_used_data":23764,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94244896,"statfs":{"total":96636764160,"available":96506773504,"internally_reserved":0,"allocated":24334336,"data_stored":48257714,"data_compressed":2479360,"data_compressed_allocated":23769088,"data_compressed_original":48029696,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23769088,"data_stored":47538176,"data_compressed":2453623,"data_compressed_allocated":23769088,"data_compressed_original":47538176,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15683584,"data_stored":31367168,"data_compressed":1619041,"data_compressed_allocated":15683584,"data_compressed_original":31367168,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16605184,"data_stored":33210368,"data_compressed":1714140,"data_compressed_allocated":16605184,"data_compressed_original":33210368,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21270528,"data_stored":42541056,"data_compressed":2195683,"data_compressed_allocated":21270528,"data_compressed_original":42541056,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:39:35.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 6766 6750 1.09853 0.960938 0.15676 0.113599 2024-04-25T09:39:36.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 6903 6887 1.09795 1.07031 0.192461 0.113648 2024-04-25T09:39:36.777 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:36.916 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:36.922+0000 7ff3d211d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:36.922 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:36.931+0000 7ff3d211d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:37.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 7031 7015 1.09599 1 0.090511 0.113867 2024-04-25T09:39:38.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 7176 7160 1.09671 1.13281 0.126502 0.113818 2024-04-25T09:39:39.086 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:39.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:39.224+0000 7f5f4f19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:39.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:39.233+0000 7f5f4f19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:39.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 7319 7303 1.0971 1.11719 0.165135 0.113781 2024-04-25T09:39:40.161 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:40.162 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:40.162 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:39:40.162 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:39:40.292 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.295+0000 7f695099d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.305+0000 7f695099d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.344 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:40.344 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:40.344 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:40.344 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:40.344 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:40.344 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:40.344 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:40.345 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:40.345 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:40.345 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:40.345 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:40.345 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:40.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:40.347 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:40.348 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:39:40.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.493+0000 7fe5a12ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.505+0000 7fe5a12ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:40.515 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:40.516 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:40.516 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:40.518 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:40.518 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:40.518 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:39:40.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 7448 7432 1.09542 1.00781 0.222947 0.113931 2024-04-25T09:39:40.662 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.665+0000 7fcb8f4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.675+0000 7fcb8f4ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.696 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:40.697 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:40.700 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:40.700 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:40.700 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:39:40.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.867+0000 7fbc45ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.868 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:40.877+0000 7fbc45ced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:40.884 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:40.884 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:40.884 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:40.884 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:40.884 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:40.885 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:40.885 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:40.885 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:40.885 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:40.885 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:40.885 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:40.885 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:40.887 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:40.887 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:41.458 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:41.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 7563 7547 1.09177 0.898438 0.170927 0.114323 2024-04-25T09:39:41.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:41.585+0000 7fea96aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:41.582 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:41.591+0000 7fea96aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:42.550 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 7703 7687 1.0918 1.09375 0.117386 0.114355 2024-04-25T09:39:43.551 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 7831 7815 1.09016 1 0.0834931 0.114514 2024-04-25T09:39:43.784 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:43.924 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:43.930+0000 7f8136d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:43.928 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:43.937+0000 7f8136d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:44.551 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 7978 7962 1.09118 1.14844 0.128667 0.11439 2024-04-25T09:39:45.551 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 8109 8093 1.09001 1.02344 0.0231988 0.114541 2024-04-25T09:39:45.889 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:45.889 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:45.889 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:39:45.890 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:39:46.014 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.016+0000 7f1ff7cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.026+0000 7f1ff7cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.060 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:46.060 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:46.060 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:46.060 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:46.060 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:46.061 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:46.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:46.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:46.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:46.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:46.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:46.061 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:46.063 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:46.064 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:46.064 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:39:46.190 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:46.195 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.194+0000 7f54cb4ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.209+0000 7f54cb4ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.223 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:46.223 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:46.223 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:46.223 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:46.224 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:46.227 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:46.228 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:46.228 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:39:46.357 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.362+0000 7f72b6d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.362 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.370+0000 7f72b6d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.396 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.399+0000 7f34aaf9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.409+0000 7f34aaf9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.425 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:46.425 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:46.426 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:46.428 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:46.429 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:46.429 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:39:46.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 8239 8223 1.08875 1.01562 0.165637 0.114651 2024-04-25T09:39:46.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.565+0000 7f3cfd006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:46.578+0000 7f3cfd006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:46.608 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:39:46.608 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:39:46.608 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:39:46.608 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:39:46.608 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:39:46.608 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:39:46.608 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:39:46.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:39:46.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:39:46.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:39:46.609 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:39:46.609 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:39:46.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:39:46.613 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:39:47.551 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:39:47.560893+0000 min lat: 0.0148973 max lat: 0.425634 avg lat: 0.114782 2024-04-25T09:39:47.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:39:47.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 8371 8355 1.08779 1.03125 0.113962 0.114782 2024-04-25T09:39:48.551 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 8506 8490 1.08724 1.05469 0.135092 0.114814 2024-04-25T09:39:48.584 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:48.719 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:48.724+0000 7fd05575d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:48.723 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:48.731+0000 7fd05575d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:49.551 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 8635 8619 1.08596 1.00781 0.138045 0.114958 2024-04-25T09:39:50.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 8776 8760 1.08621 1.10156 0.113138 0.11495 2024-04-25T09:39:50.926 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:51.054 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:51.060+0000 7f839079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:51.058 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:51.067+0000 7f839079d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:51.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 8904 8888 1.08486 1 0.138835 0.115075 2024-04-25T09:39:51.614 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:51.614 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:39:51.615 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:39:51.755 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:51.757+0000 7f92e9cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:51.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:51.768+0000 7f92e9cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:52.004 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:39:52.005 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:39:52.020 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-04-25T09:39:51.381829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68387360,"num_objects":1039,"num_object_clones":0,"num_object_copies":3117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":8413,"num_write_kb":68102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8357,"ondisk_log_size":8357,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":526688,"kb_used_data":101504,"kb_used_omap":0,"kb_used_meta":425152,"kb_avail":376960672,"statfs":{"total":386547056640,"available":386007728128,"internally_reserved":0,"allocated":103940096,"data_stored":205768872,"data_compressed":10576548,"data_compressed_allocated":101699584,"data_compressed_original":204873728,"omap_allocated":0,"internal_metadata":435355648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11141120,"num_objects":171,"num_object_clones":0,"num_object_copies":513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002972"},"pg_stats":[{"pgid":"9.7","version":"88'520","reported_seq":543,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:44.981273+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:44.981273+0000","last_peered":"2024-04-25T09:39:44.981273+0000","last_clean":"2024-04-25T09:39:44.981273+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:44.981273+0000","last_undegraded":"2024-04-25T09:39:44.981273+0000","last_fullsized":"2024-04-25T09:39:44.981273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4268032,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":521,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"88'546","reported_seq":571,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:46.466783+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:46.466783+0000","last_peered":"2024-04-25T09:39:46.466783+0000","last_clean":"2024-04-25T09:39:46.466783+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:46.466783+0000","last_undegraded":"2024-04-25T09:39:46.466783+0000","last_fullsized":"2024-04-25T09:39:46.466783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4481024,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":547,"num_write_kb":4376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"88'495","reported_seq":520,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:47.475088+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:47.475088+0000","last_peered":"2024-04-25T09:39:47.475088+0000","last_clean":"2024-04-25T09:39:47.475088+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:47.475088+0000","last_undegraded":"2024-04-25T09:39:47.475088+0000","last_fullsized":"2024-04-25T09:39:47.475088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'535","reported_seq":560,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:46.874811+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:46.874811+0000","last_peered":"2024-04-25T09:39:46.874811+0000","last_clean":"2024-04-25T09:39:46.874811+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:46.874811+0000","last_undegraded":"2024-04-25T09:39:46.874811+0000","last_fullsized":"2024-04-25T09:39:46.874811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"88'543","reported_seq":566,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:46.452289+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:46.452289+0000","last_peered":"2024-04-25T09:39:46.452289+0000","last_clean":"2024-04-25T09:39:46.452289+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:46.452289+0000","last_undegraded":"2024-04-25T09:39:46.452289+0000","last_fullsized":"2024-04-25T09:39:46.452289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"88'561","reported_seq":586,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:46.446257+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:39:46.446257+0000","last_peered":"2024-04-25T09:39:46.446257+0000","last_clean":"2024-04-25T09:39:46.446257+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:39:46.446257+0000","last_undegraded":"2024-04-25T09:39:46.446257+0000","last_fullsized":"2024-04-25T09:39:46.446257+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4603904,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":4496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"88'519","reported_seq":542,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:43.387922+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:43.387922+0000","last_peered":"2024-04-25T09:39:43.387922+0000","last_clean":"2024-04-25T09:39:43.387922+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:43.387922+0000","last_undegraded":"2024-04-25T09:39:43.387922+0000","last_fullsized":"2024-04-25T09:39:43.387922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'519","reported_seq":544,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:47.124903+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:47.124903+0000","last_peered":"2024-04-25T09:39:47.124903+0000","last_clean":"2024-04-25T09:39:47.124903+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:47.124903+0000","last_undegraded":"2024-04-25T09:39:47.124903+0000","last_fullsized":"2024-04-25T09:39:47.124903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"88'527","reported_seq":550,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:45.367743+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:45.367743+0000","last_peered":"2024-04-25T09:39:45.367743+0000","last_clean":"2024-04-25T09:39:45.367743+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:45.367743+0000","last_undegraded":"2024-04-25T09:39:45.367743+0000","last_fullsized":"2024-04-25T09:39:45.367743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":332,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.622668+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:39:02.622668+0000","last_peered":"2024-04-25T09:39:02.622668+0000","last_clean":"2024-04-25T09:39:02.622668+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:39:02.622668+0000","last_undegraded":"2024-04-25T09:39:02.622668+0000","last_fullsized":"2024-04-25T09:39:02.622668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.694171+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:02.694171+0000","last_peered":"2024-04-25T09:39:02.694171+0000","last_clean":"2024-04-25T09:39:02.694171+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:02.694171+0000","last_undegraded":"2024-04-25T09:39:02.694171+0000","last_fullsized":"2024-04-25T09:39:02.694171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'543","reported_seq":566,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:45.808922+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:45.808922+0000","last_peered":"2024-04-25T09:39:45.808922+0000","last_clean":"2024-04-25T09:39:45.808922+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:45.808922+0000","last_undegraded":"2024-04-25T09:39:45.808922+0000","last_fullsized":"2024-04-25T09:39:45.808922+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639404+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:02.639404+0000","last_peered":"2024-04-25T09:39:02.639404+0000","last_clean":"2024-04-25T09:39:02.639404+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:02.639404+0000","last_undegraded":"2024-04-25T09:39:02.639404+0000","last_fullsized":"2024-04-25T09:39:02.639404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'591","reported_seq":616,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:45.847405+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:45.847405+0000","last_peered":"2024-04-25T09:39:45.847405+0000","last_clean":"2024-04-25T09:39:45.847405+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:45.847405+0000","last_undegraded":"2024-04-25T09:39:45.847405+0000","last_fullsized":"2024-04-25T09:39:45.847405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.677609+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:02.677609+0000","last_peered":"2024-04-25T09:39:02.677609+0000","last_clean":"2024-04-25T09:39:02.677609+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:02.677609+0000","last_undegraded":"2024-04-25T09:39:02.677609+0000","last_fullsized":"2024-04-25T09:39:02.677609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"88'493","reported_seq":516,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:47.461575+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:47.461575+0000","last_peered":"2024-04-25T09:39:47.461575+0000","last_clean":"2024-04-25T09:39:47.461575+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:47.461575+0000","last_undegraded":"2024-04-25T09:39:47.461575+0000","last_fullsized":"2024-04-25T09:39:47.461575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4046848,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":3952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.643068+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:02.643068+0000","last_peered":"2024-04-25T09:39:02.643068+0000","last_clean":"2024-04-25T09:39:02.643068+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:02.643068+0000","last_undegraded":"2024-04-25T09:39:02.643068+0000","last_fullsized":"2024-04-25T09:39:02.643068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"88'367","reported_seq":390,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:46.283559+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:46.283559+0000","last_peered":"2024-04-25T09:39:46.283559+0000","last_clean":"2024-04-25T09:39:46.283559+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:46.283559+0000","last_undegraded":"2024-04-25T09:39:46.283559+0000","last_fullsized":"2024-04-25T09:39:46.283559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"88'487","reported_seq":510,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:45.952669+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:45.952669+0000","last_peered":"2024-04-25T09:39:45.952669+0000","last_clean":"2024-04-25T09:39:45.952669+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:45.952669+0000","last_undegraded":"2024-04-25T09:39:45.952669+0000","last_fullsized":"2024-04-25T09:39:45.952669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639997+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:39:02.639997+0000","last_peered":"2024-04-25T09:39:02.639997+0000","last_clean":"2024-04-25T09:39:02.639997+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:39:02.639997+0000","last_undegraded":"2024-04-25T09:39:02.639997+0000","last_fullsized":"2024-04-25T09:39:02.639997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"88'503","reported_seq":526,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:47.115691+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:47.115691+0000","last_peered":"2024-04-25T09:39:47.115691+0000","last_clean":"2024-04-25T09:39:47.115691+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:47.115691+0000","last_undegraded":"2024-04-25T09:39:47.115691+0000","last_fullsized":"2024-04-25T09:39:47.115691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"88'511","reported_seq":536,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:46.448930+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:46.448930+0000","last_peered":"2024-04-25T09:39:46.448930+0000","last_clean":"2024-04-25T09:39:46.448930+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:46.448930+0000","last_undegraded":"2024-04-25T09:39:46.448930+0000","last_fullsized":"2024-04-25T09:39:46.448930+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.693995+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:02.693995+0000","last_peered":"2024-04-25T09:39:02.693995+0000","last_clean":"2024-04-25T09:39:02.693995+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:02.693995+0000","last_undegraded":"2024-04-25T09:39:02.693995+0000","last_fullsized":"2024-04-25T09:39:02.693995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":67796992,"num_objects":1037,"num_object_clones":0,"num_object_copies":3111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8276,"num_write_kb":66208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":101740544,"data_stored":203481088,"data_compressed":10503567,"data_compressed_allocated":101740544,"data_compressed_original":203481088,"omap_allocated":0,"internal_metadata":0},"log_size":8260,"ondisk_log_size":8260,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126652,"kb_used_data":27636,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94245188,"statfs":{"total":96636764160,"available":96507072512,"internally_reserved":0,"allocated":28299264,"data_stored":56187570,"data_compressed":2888914,"data_compressed_allocated":27734016,"data_compressed_original":55959552,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129040,"kb_used_data":21704,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94242800,"statfs":{"total":96636764160,"available":96504627200,"internally_reserved":0,"allocated":22224896,"data_stored":44038834,"data_compressed":2261859,"data_compressed_allocated":21659648,"data_compressed_original":43810816,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706388,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128212,"kb_used_data":20876,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94243628,"statfs":{"total":96636764160,"available":96505475072,"internally_reserved":0,"allocated":21377024,"data_stored":41875602,"data_compressed":2150752,"data_compressed_allocated":20832256,"data_compressed_original":41664512,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706388,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142784,"kb_used_data":31288,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94229056,"statfs":{"total":96636764160,"available":96490553344,"internally_reserved":0,"allocated":32038912,"data_stored":63666866,"data_compressed":3275023,"data_compressed_allocated":31473664,"data_compressed_original":63438848,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":31436800,"data_stored":62873600,"data_compressed":3245479,"data_compressed_allocated":31436800,"data_compressed_original":62873600,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20860928,"data_stored":41721856,"data_compressed":2153713,"data_compressed_allocated":20860928,"data_compressed_original":41721856,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21721088,"data_stored":43442176,"data_compressed":2242467,"data_compressed_allocated":21721088,"data_compressed_original":43442176,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":27721728,"data_stored":55443456,"data_compressed":2861908,"data_compressed_allocated":27721728,"data_compressed_original":55443456,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:39:52.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 9048 9032 1.08548 1.125 0.207103 0.115003 2024-04-25T09:39:53.230 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:53.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:53.351+0000 7f2a0419d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:53.349 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:53.357+0000 7f2a0419d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:53.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 9176 9160 1.08418 1 0.198983 0.115105 2024-04-25T09:39:54.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 9310 9294 1.08362 1.04688 0.0970812 0.11524 2024-04-25T09:39:55.518 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:39:55.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 9433 9417 1.08182 0.960938 0.103287 0.115409 2024-04-25T09:39:55.637 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:55.643+0000 7f71bf6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:55.641 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:55.650+0000 7f71bf6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:56.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 9553 9537 1.07972 0.9375 0.186699 0.115634 2024-04-25T09:39:57.022 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:39:57.023 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:39:57.148 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:57.148+0000 7f81bb95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:57.153 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:57.161+0000 7f81bb95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:57.458 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:39:57.475 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:39:57.552 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 9681 9665 1.07858 1 0.136321 0.115745 2024-04-25T09:39:57.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:57.594+0000 7f819102d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:57.596 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:57.604+0000 7f819102d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:57.837 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:39:57.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:57.976+0000 7fa3f8424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:57.974 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:57.982+0000 7fa3f8424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:58.468 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:39:58.489 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:39:58.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 9788 9772 1.07516 0.835938 0.0457996 0.116037 2024-04-25T09:39:58.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:58.649+0000 7fd87546d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:58.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:58.664+0000 7fd87546d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:59.472 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:39:59.490 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:39:59.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 9895 9879 1.07184 0.835938 0.144391 0.116438 2024-04-25T09:39:59.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:59.628+0000 7f5749b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:39:59.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:39:59.640+0000 7f5749b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:00.097 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:00.230 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:00.233+0000 7f890782d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:00.232 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:00.240+0000 7f890782d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:00.478 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:40:00.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:40:00.498 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:00.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 10020 10004 1.07053 0.976562 0.172599 0.116629 2024-04-25T09:40:00.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:00.662+0000 7f6b1dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:00.665 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:00.673+0000 7f6b1dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:00.870 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:00.871 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:00.892 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-04-25T09:40:00.487800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79258144,"num_objects":1203,"num_object_clones":0,"num_object_copies":3609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9740,"num_write_kb":78718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9686,"ondisk_log_size":9686,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":554616,"kb_used_data":116952,"kb_used_omap":0,"kb_used_meta":437632,"kb_avail":376932744,"statfs":{"total":386547056640,"available":385979129856,"internally_reserved":0,"allocated":119758848,"data_stored":237393237,"data_compressed":12209328,"data_compressed_allocated":117510144,"data_compressed_original":236494848,"omap_allocated":0,"internal_metadata":448135168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5349376,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653,"num_write_kb":5224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.105062"},"pg_stats":[{"pgid":"9.7","version":"88'615","reported_seq":638,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.166690+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:55.166690+0000","last_peered":"2024-04-25T09:39:55.166690+0000","last_clean":"2024-04-25T09:39:55.166690+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:55.166690+0000","last_undegraded":"2024-04-25T09:39:55.166690+0000","last_fullsized":"2024-04-25T09:39:55.166690+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"88'623","reported_seq":648,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.964401+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:55.964401+0000","last_peered":"2024-04-25T09:39:55.964401+0000","last_clean":"2024-04-25T09:39:55.964401+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:55.964401+0000","last_undegraded":"2024-04-25T09:39:55.964401+0000","last_fullsized":"2024-04-25T09:39:55.964401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"88'567","reported_seq":592,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:54.467221+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:54.467221+0000","last_peered":"2024-04-25T09:39:54.467221+0000","last_clean":"2024-04-25T09:39:54.467221+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:54.467221+0000","last_undegraded":"2024-04-25T09:39:54.467221+0000","last_fullsized":"2024-04-25T09:39:54.467221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'599","reported_seq":624,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.476633+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:56.476633+0000","last_peered":"2024-04-25T09:39:56.476633+0000","last_clean":"2024-04-25T09:39:56.476633+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:56.476633+0000","last_undegraded":"2024-04-25T09:39:56.476633+0000","last_fullsized":"2024-04-25T09:39:56.476633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"88'576","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.521122+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:57.521122+0000","last_peered":"2024-04-25T09:39:57.521122+0000","last_clean":"2024-04-25T09:39:57.521122+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:57.521122+0000","last_undegraded":"2024-04-25T09:39:57.521122+0000","last_fullsized":"2024-04-25T09:39:57.521122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"88'655","reported_seq":680,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.579015+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:39:55.579015+0000","last_peered":"2024-04-25T09:39:55.579015+0000","last_clean":"2024-04-25T09:39:55.579015+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:39:55.579015+0000","last_undegraded":"2024-04-25T09:39:55.579015+0000","last_fullsized":"2024-04-25T09:39:55.579015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"88'607","reported_seq":630,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.062691+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:55.062691+0000","last_peered":"2024-04-25T09:39:55.062691+0000","last_clean":"2024-04-25T09:39:55.062691+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:55.062691+0000","last_undegraded":"2024-04-25T09:39:55.062691+0000","last_fullsized":"2024-04-25T09:39:55.062691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'623","reported_seq":648,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.119642+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:57.119642+0000","last_peered":"2024-04-25T09:39:57.119642+0000","last_clean":"2024-04-25T09:39:57.119642+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:57.119642+0000","last_undegraded":"2024-04-25T09:39:57.119642+0000","last_fullsized":"2024-04-25T09:39:57.119642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"88'615","reported_seq":638,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.348887+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:57.348887+0000","last_peered":"2024-04-25T09:39:57.348887+0000","last_clean":"2024-04-25T09:39:57.348887+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:57.348887+0000","last_undegraded":"2024-04-25T09:39:57.348887+0000","last_fullsized":"2024-04-25T09:39:57.348887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":333,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.623085+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:39:02.623085+0000","last_peered":"2024-04-25T09:39:02.623085+0000","last_clean":"2024-04-25T09:39:02.623085+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:39:02.623085+0000","last_undegraded":"2024-04-25T09:39:02.623085+0000","last_fullsized":"2024-04-25T09:39:02.623085+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.694171+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:02.694171+0000","last_peered":"2024-04-25T09:39:02.694171+0000","last_clean":"2024-04-25T09:39:02.694171+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:02.694171+0000","last_undegraded":"2024-04-25T09:39:02.694171+0000","last_fullsized":"2024-04-25T09:39:02.694171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'583","reported_seq":606,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.369682+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:56.369682+0000","last_peered":"2024-04-25T09:39:56.369682+0000","last_clean":"2024-04-25T09:39:56.369682+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:56.369682+0000","last_undegraded":"2024-04-25T09:39:56.369682+0000","last_fullsized":"2024-04-25T09:39:56.369682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639404+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:02.639404+0000","last_peered":"2024-04-25T09:39:02.639404+0000","last_clean":"2024-04-25T09:39:02.639404+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:02.639404+0000","last_undegraded":"2024-04-25T09:39:02.639404+0000","last_fullsized":"2024-04-25T09:39:02.639404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'654","reported_seq":679,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.487684+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:57.487684+0000","last_peered":"2024-04-25T09:39:57.487684+0000","last_clean":"2024-04-25T09:39:57.487684+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:57.487684+0000","last_undegraded":"2024-04-25T09:39:57.487684+0000","last_fullsized":"2024-04-25T09:39:57.487684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5365760,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":5240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.677609+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:02.677609+0000","last_peered":"2024-04-25T09:39:02.677609+0000","last_clean":"2024-04-25T09:39:02.677609+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:02.677609+0000","last_undegraded":"2024-04-25T09:39:02.677609+0000","last_fullsized":"2024-04-25T09:39:02.677609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"88'606","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.456293+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:57.456293+0000","last_peered":"2024-04-25T09:39:57.456293+0000","last_clean":"2024-04-25T09:39:57.456293+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:57.456293+0000","last_undegraded":"2024-04-25T09:39:57.456293+0000","last_fullsized":"2024-04-25T09:39:57.456293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4972544,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":4856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.643068+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:02.643068+0000","last_peered":"2024-04-25T09:39:02.643068+0000","last_clean":"2024-04-25T09:39:02.643068+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:02.643068+0000","last_undegraded":"2024-04-25T09:39:02.643068+0000","last_fullsized":"2024-04-25T09:39:02.643068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"88'463","reported_seq":486,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.315180+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:55.315180+0000","last_peered":"2024-04-25T09:39:55.315180+0000","last_clean":"2024-04-25T09:39:55.315180+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:55.315180+0000","last_undegraded":"2024-04-25T09:39:55.315180+0000","last_fullsized":"2024-04-25T09:39:55.315180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"88'583","reported_seq":606,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.060413+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:56.060413+0000","last_peered":"2024-04-25T09:39:56.060413+0000","last_clean":"2024-04-25T09:39:56.060413+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:56.060413+0000","last_undegraded":"2024-04-25T09:39:56.060413+0000","last_fullsized":"2024-04-25T09:39:56.060413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639997+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:39:02.639997+0000","last_peered":"2024-04-25T09:39:02.639997+0000","last_clean":"2024-04-25T09:39:02.639997+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:39:02.639997+0000","last_undegraded":"2024-04-25T09:39:02.639997+0000","last_fullsized":"2024-04-25T09:39:02.639997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"88'608","reported_seq":631,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.219390+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:57.219390+0000","last_peered":"2024-04-25T09:39:57.219390+0000","last_clean":"2024-04-25T09:39:57.219390+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:57.219390+0000","last_undegraded":"2024-04-25T09:39:57.219390+0000","last_fullsized":"2024-04-25T09:39:57.219390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"88'612","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.466679+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:56.466679+0000","last_peered":"2024-04-25T09:39:56.466679+0000","last_clean":"2024-04-25T09:39:56.466679+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:56.466679+0000","last_undegraded":"2024-04-25T09:39:56.466679+0000","last_fullsized":"2024-04-25T09:39:56.466679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5021696,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.693995+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:02.693995+0000","last_peered":"2024-04-25T09:39:02.693995+0000","last_clean":"2024-04-25T09:39:02.693995+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:02.693995+0000","last_undegraded":"2024-04-25T09:39:02.693995+0000","last_fullsized":"2024-04-25T09:39:02.693995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":78667776,"num_objects":1201,"num_object_clones":0,"num_object_copies":3603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9603,"num_write_kb":76824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117960704,"data_stored":235921408,"data_compressed":12178647,"data_compressed_allocated":117960704,"data_compressed_original":235921408,"omap_allocated":0,"internal_metadata":0},"log_size":9589,"ondisk_log_size":9589,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134932,"kb_used_data":31756,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94236908,"statfs":{"total":96636764160,"available":96498593792,"internally_reserved":0,"allocated":32518144,"data_stored":64612191,"data_compressed":3323758,"data_compressed_allocated":31944704,"data_compressed_original":64380928,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132344,"kb_used_data":25008,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94239496,"statfs":{"total":96636764160,"available":96501243904,"internally_reserved":0,"allocated":25608192,"data_stored":50805426,"data_compressed":2611257,"data_compressed_allocated":25042944,"data_compressed_original":50577408,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135904,"kb_used_data":24408,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94235936,"statfs":{"total":96636764160,"available":96497598464,"internally_reserved":0,"allocated":24993792,"data_stored":49109138,"data_compressed":2524261,"data_compressed_allocated":24449024,"data_compressed_original":48898048,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151436,"kb_used_data":35780,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94220404,"statfs":{"total":96636764160,"available":96481693696,"internally_reserved":0,"allocated":36638720,"data_stored":72866482,"data_compressed":3750052,"data_compressed_allocated":36073472,"data_compressed_original":72638464,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36507648,"data_stored":73015296,"data_compressed":3769153,"data_compressed_allocated":36507648,"data_compressed_original":73015296,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24465408,"data_stored":48930816,"data_compressed":2525953,"data_compressed_allocated":24465408,"data_compressed_original":48930816,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25071616,"data_stored":50143232,"data_compressed":2588481,"data_compressed_allocated":25071616,"data_compressed_original":50143232,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31916032,"data_stored":63832064,"data_compressed":3295060,"data_compressed_allocated":31916032,"data_compressed_original":63832064,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:00.895 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:01.078 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:01.082+0000 7f11de2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:01.083 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:01.091+0000 7f11de2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:01.353 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:01.353 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:01.371 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-04-25T09:40:00.487800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79258144,"num_objects":1203,"num_object_clones":0,"num_object_copies":3609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9740,"num_write_kb":78718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9686,"ondisk_log_size":9686,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":554616,"kb_used_data":116952,"kb_used_omap":0,"kb_used_meta":437632,"kb_avail":376932744,"statfs":{"total":386547056640,"available":385979129856,"internally_reserved":0,"allocated":119758848,"data_stored":237393237,"data_compressed":12209328,"data_compressed_allocated":117510144,"data_compressed_original":236494848,"omap_allocated":0,"internal_metadata":448135168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5349376,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":653,"num_write_kb":5224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.105062"},"pg_stats":[{"pgid":"9.7","version":"88'615","reported_seq":638,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.166690+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:55.166690+0000","last_peered":"2024-04-25T09:39:55.166690+0000","last_clean":"2024-04-25T09:39:55.166690+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:55.166690+0000","last_undegraded":"2024-04-25T09:39:55.166690+0000","last_fullsized":"2024-04-25T09:39:55.166690+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"88'623","reported_seq":648,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.964401+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:55.964401+0000","last_peered":"2024-04-25T09:39:55.964401+0000","last_clean":"2024-04-25T09:39:55.964401+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:55.964401+0000","last_undegraded":"2024-04-25T09:39:55.964401+0000","last_fullsized":"2024-04-25T09:39:55.964401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"88'567","reported_seq":592,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:54.467221+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:54.467221+0000","last_peered":"2024-04-25T09:39:54.467221+0000","last_clean":"2024-04-25T09:39:54.467221+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:54.467221+0000","last_undegraded":"2024-04-25T09:39:54.467221+0000","last_fullsized":"2024-04-25T09:39:54.467221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'599","reported_seq":624,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.476633+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:56.476633+0000","last_peered":"2024-04-25T09:39:56.476633+0000","last_clean":"2024-04-25T09:39:56.476633+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:56.476633+0000","last_undegraded":"2024-04-25T09:39:56.476633+0000","last_fullsized":"2024-04-25T09:39:56.476633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"88'576","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.521122+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:57.521122+0000","last_peered":"2024-04-25T09:39:57.521122+0000","last_clean":"2024-04-25T09:39:57.521122+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:57.521122+0000","last_undegraded":"2024-04-25T09:39:57.521122+0000","last_fullsized":"2024-04-25T09:39:57.521122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"88'655","reported_seq":680,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.579015+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:39:55.579015+0000","last_peered":"2024-04-25T09:39:55.579015+0000","last_clean":"2024-04-25T09:39:55.579015+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:39:55.579015+0000","last_undegraded":"2024-04-25T09:39:55.579015+0000","last_fullsized":"2024-04-25T09:39:55.579015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"88'607","reported_seq":630,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.062691+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:55.062691+0000","last_peered":"2024-04-25T09:39:55.062691+0000","last_clean":"2024-04-25T09:39:55.062691+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:55.062691+0000","last_undegraded":"2024-04-25T09:39:55.062691+0000","last_fullsized":"2024-04-25T09:39:55.062691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'623","reported_seq":648,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.119642+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:57.119642+0000","last_peered":"2024-04-25T09:39:57.119642+0000","last_clean":"2024-04-25T09:39:57.119642+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:57.119642+0000","last_undegraded":"2024-04-25T09:39:57.119642+0000","last_fullsized":"2024-04-25T09:39:57.119642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"88'615","reported_seq":638,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.348887+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:57.348887+0000","last_peered":"2024-04-25T09:39:57.348887+0000","last_clean":"2024-04-25T09:39:57.348887+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:57.348887+0000","last_undegraded":"2024-04-25T09:39:57.348887+0000","last_fullsized":"2024-04-25T09:39:57.348887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":333,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.623085+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:39:02.623085+0000","last_peered":"2024-04-25T09:39:02.623085+0000","last_clean":"2024-04-25T09:39:02.623085+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:39:02.623085+0000","last_undegraded":"2024-04-25T09:39:02.623085+0000","last_fullsized":"2024-04-25T09:39:02.623085+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.694171+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:02.694171+0000","last_peered":"2024-04-25T09:39:02.694171+0000","last_clean":"2024-04-25T09:39:02.694171+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:02.694171+0000","last_undegraded":"2024-04-25T09:39:02.694171+0000","last_fullsized":"2024-04-25T09:39:02.694171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'583","reported_seq":606,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.369682+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:56.369682+0000","last_peered":"2024-04-25T09:39:56.369682+0000","last_clean":"2024-04-25T09:39:56.369682+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:56.369682+0000","last_undegraded":"2024-04-25T09:39:56.369682+0000","last_fullsized":"2024-04-25T09:39:56.369682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639404+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:02.639404+0000","last_peered":"2024-04-25T09:39:02.639404+0000","last_clean":"2024-04-25T09:39:02.639404+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:02.639404+0000","last_undegraded":"2024-04-25T09:39:02.639404+0000","last_fullsized":"2024-04-25T09:39:02.639404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'654","reported_seq":679,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.487684+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:57.487684+0000","last_peered":"2024-04-25T09:39:57.487684+0000","last_clean":"2024-04-25T09:39:57.487684+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:57.487684+0000","last_undegraded":"2024-04-25T09:39:57.487684+0000","last_fullsized":"2024-04-25T09:39:57.487684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5365760,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":5240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.677609+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:02.677609+0000","last_peered":"2024-04-25T09:39:02.677609+0000","last_clean":"2024-04-25T09:39:02.677609+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:02.677609+0000","last_undegraded":"2024-04-25T09:39:02.677609+0000","last_fullsized":"2024-04-25T09:39:02.677609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"88'606","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.456293+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:57.456293+0000","last_peered":"2024-04-25T09:39:57.456293+0000","last_clean":"2024-04-25T09:39:57.456293+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:57.456293+0000","last_undegraded":"2024-04-25T09:39:57.456293+0000","last_fullsized":"2024-04-25T09:39:57.456293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4972544,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":4856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.643068+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:02.643068+0000","last_peered":"2024-04-25T09:39:02.643068+0000","last_clean":"2024-04-25T09:39:02.643068+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:02.643068+0000","last_undegraded":"2024-04-25T09:39:02.643068+0000","last_fullsized":"2024-04-25T09:39:02.643068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"88'463","reported_seq":486,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.315180+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:55.315180+0000","last_peered":"2024-04-25T09:39:55.315180+0000","last_clean":"2024-04-25T09:39:55.315180+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:55.315180+0000","last_undegraded":"2024-04-25T09:39:55.315180+0000","last_fullsized":"2024-04-25T09:39:55.315180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"88'583","reported_seq":606,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.060413+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:56.060413+0000","last_peered":"2024-04-25T09:39:56.060413+0000","last_clean":"2024-04-25T09:39:56.060413+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:56.060413+0000","last_undegraded":"2024-04-25T09:39:56.060413+0000","last_fullsized":"2024-04-25T09:39:56.060413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639997+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:39:02.639997+0000","last_peered":"2024-04-25T09:39:02.639997+0000","last_clean":"2024-04-25T09:39:02.639997+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:39:02.639997+0000","last_undegraded":"2024-04-25T09:39:02.639997+0000","last_fullsized":"2024-04-25T09:39:02.639997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"88'608","reported_seq":631,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.219390+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:57.219390+0000","last_peered":"2024-04-25T09:39:57.219390+0000","last_clean":"2024-04-25T09:39:57.219390+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:57.219390+0000","last_undegraded":"2024-04-25T09:39:57.219390+0000","last_fullsized":"2024-04-25T09:39:57.219390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"88'612","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.466679+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:56.466679+0000","last_peered":"2024-04-25T09:39:56.466679+0000","last_clean":"2024-04-25T09:39:56.466679+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:56.466679+0000","last_undegraded":"2024-04-25T09:39:56.466679+0000","last_fullsized":"2024-04-25T09:39:56.466679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5021696,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.693995+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:02.693995+0000","last_peered":"2024-04-25T09:39:02.693995+0000","last_clean":"2024-04-25T09:39:02.693995+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:02.693995+0000","last_undegraded":"2024-04-25T09:39:02.693995+0000","last_fullsized":"2024-04-25T09:39:02.693995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":78667776,"num_objects":1201,"num_object_clones":0,"num_object_copies":3603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9603,"num_write_kb":76824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117960704,"data_stored":235921408,"data_compressed":12178647,"data_compressed_allocated":117960704,"data_compressed_original":235921408,"omap_allocated":0,"internal_metadata":0},"log_size":9589,"ondisk_log_size":9589,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134932,"kb_used_data":31756,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94236908,"statfs":{"total":96636764160,"available":96498593792,"internally_reserved":0,"allocated":32518144,"data_stored":64612191,"data_compressed":3323758,"data_compressed_allocated":31944704,"data_compressed_original":64380928,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132344,"kb_used_data":25008,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94239496,"statfs":{"total":96636764160,"available":96501243904,"internally_reserved":0,"allocated":25608192,"data_stored":50805426,"data_compressed":2611257,"data_compressed_allocated":25042944,"data_compressed_original":50577408,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135904,"kb_used_data":24408,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94235936,"statfs":{"total":96636764160,"available":96497598464,"internally_reserved":0,"allocated":24993792,"data_stored":49109138,"data_compressed":2524261,"data_compressed_allocated":24449024,"data_compressed_original":48898048,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151436,"kb_used_data":35780,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94220404,"statfs":{"total":96636764160,"available":96481693696,"internally_reserved":0,"allocated":36638720,"data_stored":72866482,"data_compressed":3750052,"data_compressed_allocated":36073472,"data_compressed_original":72638464,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36507648,"data_stored":73015296,"data_compressed":3769153,"data_compressed_allocated":36507648,"data_compressed_original":73015296,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24465408,"data_stored":48930816,"data_compressed":2525953,"data_compressed_allocated":24465408,"data_compressed_original":48930816,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25071616,"data_stored":50143232,"data_compressed":2588481,"data_compressed_allocated":25071616,"data_compressed_original":50143232,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31916032,"data_stored":63832064,"data_compressed":3295060,"data_compressed_allocated":31916032,"data_compressed_original":63832064,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:01.373 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:40:01.373 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:01.373 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:01.497 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:01.500+0000 7f08b246d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:01.502 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:01.510+0000 7f08b246d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:01.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 10141 10125 1.06884 0.945312 0.362643 0.116815 2024-04-25T09:40:01.718 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:01.718 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:01.735 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2024-04-25T09:40:01.383863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":79258144,"num_objects":1203,"num_object_clones":0,"num_object_copies":3609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9740,"num_write_kb":78718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9686,"ondisk_log_size":9686,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":554616,"kb_used_data":116952,"kb_used_omap":0,"kb_used_meta":437632,"kb_avail":376932744,"statfs":{"total":386547056640,"available":385979129856,"internally_reserved":0,"allocated":119758848,"data_stored":237393237,"data_compressed":12209328,"data_compressed_allocated":117510144,"data_compressed_original":236494848,"omap_allocated":0,"internal_metadata":448135168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2826240,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":345,"num_write_kb":2760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000711"},"pg_stats":[{"pgid":"9.7","version":"88'615","reported_seq":638,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.166690+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:39:55.166690+0000","last_peered":"2024-04-25T09:39:55.166690+0000","last_clean":"2024-04-25T09:39:55.166690+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:39:55.166690+0000","last_undegraded":"2024-04-25T09:39:55.166690+0000","last_fullsized":"2024-04-25T09:39:55.166690+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"88'623","reported_seq":648,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.964401+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:39:55.964401+0000","last_peered":"2024-04-25T09:39:55.964401+0000","last_clean":"2024-04-25T09:39:55.964401+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:39:55.964401+0000","last_undegraded":"2024-04-25T09:39:55.964401+0000","last_fullsized":"2024-04-25T09:39:55.964401+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"88'567","reported_seq":592,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:54.467221+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:39:54.467221+0000","last_peered":"2024-04-25T09:39:54.467221+0000","last_clean":"2024-04-25T09:39:54.467221+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:39:54.467221+0000","last_undegraded":"2024-04-25T09:39:54.467221+0000","last_fullsized":"2024-04-25T09:39:54.467221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"88'599","reported_seq":624,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.476633+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:39:56.476633+0000","last_peered":"2024-04-25T09:39:56.476633+0000","last_clean":"2024-04-25T09:39:56.476633+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:39:56.476633+0000","last_undegraded":"2024-04-25T09:39:56.476633+0000","last_fullsized":"2024-04-25T09:39:56.476633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"88'576","reported_seq":601,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.521122+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:39:57.521122+0000","last_peered":"2024-04-25T09:39:57.521122+0000","last_clean":"2024-04-25T09:39:57.521122+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:39:57.521122+0000","last_undegraded":"2024-04-25T09:39:57.521122+0000","last_fullsized":"2024-04-25T09:39:57.521122+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"88'655","reported_seq":680,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.579015+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:39:55.579015+0000","last_peered":"2024-04-25T09:39:55.579015+0000","last_clean":"2024-04-25T09:39:55.579015+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:39:55.579015+0000","last_undegraded":"2024-04-25T09:39:55.579015+0000","last_fullsized":"2024-04-25T09:39:55.579015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"88'607","reported_seq":630,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.062691+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:39:55.062691+0000","last_peered":"2024-04-25T09:39:55.062691+0000","last_clean":"2024-04-25T09:39:55.062691+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:39:55.062691+0000","last_undegraded":"2024-04-25T09:39:55.062691+0000","last_fullsized":"2024-04-25T09:39:55.062691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"88'623","reported_seq":648,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.119642+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:39:57.119642+0000","last_peered":"2024-04-25T09:39:57.119642+0000","last_clean":"2024-04-25T09:39:57.119642+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:39:57.119642+0000","last_undegraded":"2024-04-25T09:39:57.119642+0000","last_fullsized":"2024-04-25T09:39:57.119642+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"88'615","reported_seq":638,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.348887+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:39:57.348887+0000","last_peered":"2024-04-25T09:39:57.348887+0000","last_clean":"2024-04-25T09:39:57.348887+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:39:57.348887+0000","last_undegraded":"2024-04-25T09:39:57.348887+0000","last_fullsized":"2024-04-25T09:39:57.348887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":333,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.623085+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:39:02.623085+0000","last_peered":"2024-04-25T09:39:02.623085+0000","last_clean":"2024-04-25T09:39:02.623085+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:39:02.623085+0000","last_undegraded":"2024-04-25T09:39:02.623085+0000","last_fullsized":"2024-04-25T09:39:02.623085+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.694171+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:02.694171+0000","last_peered":"2024-04-25T09:39:02.694171+0000","last_clean":"2024-04-25T09:39:02.694171+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:02.694171+0000","last_undegraded":"2024-04-25T09:39:02.694171+0000","last_fullsized":"2024-04-25T09:39:02.694171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'583","reported_seq":606,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.369682+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:56.369682+0000","last_peered":"2024-04-25T09:39:56.369682+0000","last_clean":"2024-04-25T09:39:56.369682+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:56.369682+0000","last_undegraded":"2024-04-25T09:39:56.369682+0000","last_fullsized":"2024-04-25T09:39:56.369682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639404+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:02.639404+0000","last_peered":"2024-04-25T09:39:02.639404+0000","last_clean":"2024-04-25T09:39:02.639404+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:02.639404+0000","last_undegraded":"2024-04-25T09:39:02.639404+0000","last_fullsized":"2024-04-25T09:39:02.639404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"88'654","reported_seq":679,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.487684+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:39:57.487684+0000","last_peered":"2024-04-25T09:39:57.487684+0000","last_clean":"2024-04-25T09:39:57.487684+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:39:57.487684+0000","last_undegraded":"2024-04-25T09:39:57.487684+0000","last_fullsized":"2024-04-25T09:39:57.487684+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5365760,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":655,"num_write_kb":5240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.677609+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:02.677609+0000","last_peered":"2024-04-25T09:39:02.677609+0000","last_clean":"2024-04-25T09:39:02.677609+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:02.677609+0000","last_undegraded":"2024-04-25T09:39:02.677609+0000","last_fullsized":"2024-04-25T09:39:02.677609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"88'606","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.456293+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:39:57.456293+0000","last_peered":"2024-04-25T09:39:57.456293+0000","last_clean":"2024-04-25T09:39:57.456293+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:39:57.456293+0000","last_undegraded":"2024-04-25T09:39:57.456293+0000","last_fullsized":"2024-04-25T09:39:57.456293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4972544,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":4856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.643068+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:02.643068+0000","last_peered":"2024-04-25T09:39:02.643068+0000","last_clean":"2024-04-25T09:39:02.643068+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:02.643068+0000","last_undegraded":"2024-04-25T09:39:02.643068+0000","last_fullsized":"2024-04-25T09:39:02.643068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"88'463","reported_seq":486,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:55.315180+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:39:55.315180+0000","last_peered":"2024-04-25T09:39:55.315180+0000","last_clean":"2024-04-25T09:39:55.315180+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:39:55.315180+0000","last_undegraded":"2024-04-25T09:39:55.315180+0000","last_fullsized":"2024-04-25T09:39:55.315180+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.426723+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:39:00.426723+0000","last_peered":"2024-04-25T09:39:00.426723+0000","last_clean":"2024-04-25T09:39:00.426723+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:39:00.426723+0000","last_undegraded":"2024-04-25T09:39:00.426723+0000","last_fullsized":"2024-04-25T09:39:00.426723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"88'583","reported_seq":606,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.060413+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:39:56.060413+0000","last_peered":"2024-04-25T09:39:56.060413+0000","last_clean":"2024-04-25T09:39:56.060413+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:39:56.060413+0000","last_undegraded":"2024-04-25T09:39:56.060413+0000","last_fullsized":"2024-04-25T09:39:56.060413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.639997+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:39:02.639997+0000","last_peered":"2024-04-25T09:39:02.639997+0000","last_clean":"2024-04-25T09:39:02.639997+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:39:02.639997+0000","last_undegraded":"2024-04-25T09:39:02.639997+0000","last_fullsized":"2024-04-25T09:39:02.639997+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"88'608","reported_seq":631,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-25T09:39:57.219390+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:39:57.219390+0000","last_peered":"2024-04-25T09:39:57.219390+0000","last_clean":"2024-04-25T09:39:57.219390+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:39:57.219390+0000","last_undegraded":"2024-04-25T09:39:57.219390+0000","last_fullsized":"2024-04-25T09:39:57.219390+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:00.420925+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:39:00.420925+0000","last_peered":"2024-04-25T09:39:00.420925+0000","last_clean":"2024-04-25T09:39:00.420925+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:39:00.420925+0000","last_undegraded":"2024-04-25T09:39:00.420925+0000","last_fullsized":"2024-04-25T09:39:00.420925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"88'612","reported_seq":637,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:56.466679+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:56.466679+0000","last_peered":"2024-04-25T09:39:56.466679+0000","last_clean":"2024-04-25T09:39:56.466679+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:56.466679+0000","last_undegraded":"2024-04-25T09:39:56.466679+0000","last_fullsized":"2024-04-25T09:39:56.466679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5021696,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-25T09:39:02.693995+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:02.693995+0000","last_peered":"2024-04-25T09:39:02.693995+0000","last_clean":"2024-04-25T09:39:02.693995+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:02.693995+0000","last_undegraded":"2024-04-25T09:39:02.693995+0000","last_fullsized":"2024-04-25T09:39:02.693995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":78667776,"num_objects":1201,"num_object_clones":0,"num_object_copies":3603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9603,"num_write_kb":76824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":117960704,"data_stored":235921408,"data_compressed":12178647,"data_compressed_allocated":117960704,"data_compressed_original":235921408,"omap_allocated":0,"internal_metadata":0},"log_size":9589,"ondisk_log_size":9589,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134932,"kb_used_data":31756,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94236908,"statfs":{"total":96636764160,"available":96498593792,"internally_reserved":0,"allocated":32518144,"data_stored":64612191,"data_compressed":3323758,"data_compressed_allocated":31944704,"data_compressed_original":64380928,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132344,"kb_used_data":25008,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94239496,"statfs":{"total":96636764160,"available":96501243904,"internally_reserved":0,"allocated":25608192,"data_stored":50805426,"data_compressed":2611257,"data_compressed_allocated":25042944,"data_compressed_original":50577408,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135904,"kb_used_data":24408,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94235936,"statfs":{"total":96636764160,"available":96497598464,"internally_reserved":0,"allocated":24993792,"data_stored":49109138,"data_compressed":2524261,"data_compressed_allocated":24449024,"data_compressed_original":48898048,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706398,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151436,"kb_used_data":35780,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94220404,"statfs":{"total":96636764160,"available":96481693696,"internally_reserved":0,"allocated":36638720,"data_stored":72866482,"data_compressed":3750052,"data_compressed_allocated":36073472,"data_compressed_original":72638464,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36507648,"data_stored":73015296,"data_compressed":3769153,"data_compressed_allocated":36507648,"data_compressed_original":73015296,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24465408,"data_stored":48930816,"data_compressed":2525953,"data_compressed_allocated":24465408,"data_compressed_original":48930816,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25071616,"data_stored":50143232,"data_compressed":2588481,"data_compressed_allocated":25071616,"data_compressed_original":50143232,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31916032,"data_stored":63832064,"data_compressed":3295060,"data_compressed_allocated":31916032,"data_compressed_original":63832064,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:02.448 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:02.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 10272 10256 1.06823 1.02344 0.0443563 0.116888 2024-04-25T09:40:02.605 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:02.610+0000 7f5fed220640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:02.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:02.619+0000 7f5fed220640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:03.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 10389 10373 1.0662 0.914062 0.142463 0.117112 2024-04-25T09:40:04.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 10504 10488 1.06402 0.898438 0.111964 0.117271 2024-04-25T09:40:04.867 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:05.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:05.011+0000 7f9cac66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:05.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:05.019+0000 7f9cac66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:05.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 10625 10609 1.0625 0.945312 0.105741 0.11748 2024-04-25T09:40:06.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 10746 10730 1.06102 0.945312 0.144422 0.117702 2024-04-25T09:40:06.736 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:06.737 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:06.737 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:06.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:06.866+0000 7ff034e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:06.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:06.875+0000 7ff034e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:07.181 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:07.182 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:07.203 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":458,"stamp":"2024-04-25T09:40:05.384863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":84173344,"num_objects":1279,"num_object_clones":0,"num_object_copies":3837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10340,"num_write_kb":83518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10287,"ondisk_log_size":10287,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":553528,"kb_used_data":124184,"kb_used_omap":0,"kb_used_meta":429312,"kb_avail":376933832,"statfs":{"total":386547056640,"available":385980243968,"internally_reserved":0,"allocated":127164416,"data_stored":252046705,"data_compressed":12963960,"data_compressed_allocated":124817408,"data_compressed_original":251109376,"omap_allocated":0,"internal_metadata":439615488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4915200,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001342"},"pg_stats":[{"pgid":"9.7","version":"91'695","reported_seq":725,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.516189+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:40:00.516189+0000","last_peered":"2024-04-25T09:40:00.516189+0000","last_clean":"2024-04-25T09:40:00.516189+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:40:00.516189+0000","last_undegraded":"2024-04-25T09:40:00.516189+0000","last_fullsized":"2024-04-25T09:40:00.516189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"90'687","reported_seq":718,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T09:40:01.008278+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:40:01.008278+0000","last_peered":"2024-04-25T09:40:01.008278+0000","last_clean":"2024-04-25T09:40:01.008278+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:40:01.008278+0000","last_undegraded":"2024-04-25T09:40:01.008278+0000","last_fullsized":"2024-04-25T09:40:01.008278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"92'615","reported_seq":648,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:02.360708+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:40:02.360708+0000","last_peered":"2024-04-25T09:40:02.360708+0000","last_clean":"2024-04-25T09:40:02.360708+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:40:02.360708+0000","last_undegraded":"2024-04-25T09:40:02.360708+0000","last_fullsized":"2024-04-25T09:40:02.360708+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"92'630","reported_seq":663,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:02.449002+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:40:02.449002+0000","last_peered":"2024-04-25T09:40:02.449002+0000","last_clean":"2024-04-25T09:40:02.449002+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:40:02.449002+0000","last_undegraded":"2024-04-25T09:40:02.449002+0000","last_fullsized":"2024-04-25T09:40:02.449002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5169152,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"92'615","reported_seq":648,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:02.137659+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:40:02.137659+0000","last_peered":"2024-04-25T09:40:02.137659+0000","last_clean":"2024-04-25T09:40:02.137659+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:40:02.137659+0000","last_undegraded":"2024-04-25T09:40:02.137659+0000","last_fullsized":"2024-04-25T09:40:02.137659+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"90'695","reported_seq":726,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T09:40:01.472141+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:40:01.472141+0000","last_peered":"2024-04-25T09:40:01.472141+0000","last_clean":"2024-04-25T09:40:01.472141+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:40:01.472141+0000","last_undegraded":"2024-04-25T09:40:01.472141+0000","last_fullsized":"2024-04-25T09:40:01.472141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"91'626","reported_seq":656,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:40:01.509133+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:40:01.509133+0000","last_peered":"2024-04-25T09:40:01.509133+0000","last_clean":"2024-04-25T09:40:01.509133+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:40:01.509133+0000","last_undegraded":"2024-04-25T09:40:01.509133+0000","last_fullsized":"2024-04-25T09:40:01.509133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5136384,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":627,"num_write_kb":5016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"92'655","reported_seq":688,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:01.863445+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:40:01.863445+0000","last_peered":"2024-04-25T09:40:01.863445+0000","last_clean":"2024-04-25T09:40:01.863445+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:40:01.863445+0000","last_undegraded":"2024-04-25T09:40:01.863445+0000","last_fullsized":"2024-04-25T09:40:01.863445+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"92'648","reported_seq":681,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:01.043818+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:40:01.043818+0000","last_peered":"2024-04-25T09:40:01.043818+0000","last_clean":"2024-04-25T09:40:01.043818+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:40:01.043818+0000","last_undegraded":"2024-04-25T09:40:01.043818+0000","last_fullsized":"2024-04-25T09:40:01.043818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5316608,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":649,"num_write_kb":5192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":342,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.647155+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:00.647155+0000","last_peered":"2024-04-25T09:40:00.647155+0000","last_clean":"2024-04-25T09:40:00.647155+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:00.647155+0000","last_undegraded":"2024-04-25T09:40:00.647155+0000","last_fullsized":"2024-04-25T09:40:00.647155+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T09:39:58.623004+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:39:58.623004+0000","last_peered":"2024-04-25T09:39:58.623004+0000","last_clean":"2024-04-25T09:39:58.623004+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:39:58.623004+0000","last_undegraded":"2024-04-25T09:39:58.623004+0000","last_fullsized":"2024-04-25T09:39:58.623004+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"88'592","reported_seq":621,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:39:59.552421+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:39:59.552421+0000","last_peered":"2024-04-25T09:39:59.552421+0000","last_clean":"2024-04-25T09:39:59.552421+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:39:59.552421+0000","last_undegraded":"2024-04-25T09:39:59.552421+0000","last_fullsized":"2024-04-25T09:39:59.552421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:39:59.539412+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:39:59.539412+0000","last_peered":"2024-04-25T09:39:59.539412+0000","last_clean":"2024-04-25T09:39:59.539412+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:39:59.539412+0000","last_undegraded":"2024-04-25T09:39:59.539412+0000","last_fullsized":"2024-04-25T09:39:59.539412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"90'680","reported_seq":712,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.519244+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:40:00.519244+0000","last_peered":"2024-04-25T09:40:00.519244+0000","last_clean":"2024-04-25T09:40:00.519244+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:40:00.519244+0000","last_undegraded":"2024-04-25T09:40:00.519244+0000","last_fullsized":"2024-04-25T09:40:00.519244+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T09:39:58.589614+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:39:58.589614+0000","last_peered":"2024-04-25T09:39:58.589614+0000","last_clean":"2024-04-25T09:39:58.589614+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:39:58.589614+0000","last_undegraded":"2024-04-25T09:39:58.589614+0000","last_fullsized":"2024-04-25T09:39:58.589614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"92'663","reported_seq":696,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:02.258805+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:40:02.258805+0000","last_peered":"2024-04-25T09:40:02.258805+0000","last_clean":"2024-04-25T09:40:02.258805+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:40:02.258805+0000","last_undegraded":"2024-04-25T09:40:02.258805+0000","last_fullsized":"2024-04-25T09:40:02.258805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":204,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:39:59.536934+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:39:59.536934+0000","last_peered":"2024-04-25T09:39:59.536934+0000","last_clean":"2024-04-25T09:39:59.536934+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:39:59.536934+0000","last_undegraded":"2024-04-25T09:39:59.536934+0000","last_fullsized":"2024-04-25T09:39:59.536934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"91'511","reported_seq":541,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.837898+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:40:00.837898+0000","last_peered":"2024-04-25T09:40:00.837898+0000","last_clean":"2024-04-25T09:40:00.837898+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:40:00.837898+0000","last_undegraded":"2024-04-25T09:40:00.837898+0000","last_fullsized":"2024-04-25T09:40:00.837898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":209,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.537999+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:00.537999+0000","last_peered":"2024-04-25T09:40:00.537999+0000","last_clean":"2024-04-25T09:40:00.537999+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:00.537999+0000","last_undegraded":"2024-04-25T09:40:00.537999+0000","last_fullsized":"2024-04-25T09:40:00.537999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"91'623","reported_seq":653,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.412707+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:40:00.412707+0000","last_peered":"2024-04-25T09:40:00.412707+0000","last_clean":"2024-04-25T09:40:00.412707+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:40:00.412707+0000","last_undegraded":"2024-04-25T09:40:00.412707+0000","last_fullsized":"2024-04-25T09:40:00.412707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":209,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.676635+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:00.676635+0000","last_peered":"2024-04-25T09:40:00.676635+0000","last_clean":"2024-04-25T09:40:00.676635+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:00.676635+0000","last_undegraded":"2024-04-25T09:40:00.676635+0000","last_fullsized":"2024-04-25T09:40:00.676635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"90'616","reported_seq":648,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.649818+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:40:00.649818+0000","last_peered":"2024-04-25T09:40:00.649818+0000","last_clean":"2024-04-25T09:40:00.649818+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:40:00.649818+0000","last_undegraded":"2024-04-25T09:40:00.649818+0000","last_fullsized":"2024-04-25T09:40:00.649818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":209,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-25T09:40:00.534642+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:00.534642+0000","last_peered":"2024-04-25T09:40:00.534642+0000","last_clean":"2024-04-25T09:40:00.534642+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:00.534642+0000","last_undegraded":"2024-04-25T09:40:00.534642+0000","last_fullsized":"2024-04-25T09:40:00.534642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"90'639","reported_seq":670,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T09:39:59.059508+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:39:59.059508+0000","last_peered":"2024-04-25T09:39:59.059508+0000","last_clean":"2024-04-25T09:39:59.059508+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:39:59.059508+0000","last_undegraded":"2024-04-25T09:39:59.059508+0000","last_fullsized":"2024-04-25T09:39:59.059508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":203,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-25T09:39:58.619048+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:39:58.619048+0000","last_peered":"2024-04-25T09:39:58.619048+0000","last_clean":"2024-04-25T09:39:58.619048+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:39:58.619048+0000","last_undegraded":"2024-04-25T09:39:58.619048+0000","last_fullsized":"2024-04-25T09:39:58.619048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":83582976,"num_objects":1277,"num_object_clones":0,"num_object_copies":3831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10203,"num_write_kb":81624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":125239296,"data_stored":250478592,"data_compressed":12930318,"data_compressed_allocated":125239296,"data_compressed_original":250478592,"omap_allocated":0,"internal_metadata":0},"log_size":10190,"ondisk_log_size":10190,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673699,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141068,"kb_used_data":33732,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94230772,"statfs":{"total":96636764160,"available":96492310528,"internally_reserved":0,"allocated":34541568,"data_stored":68619622,"data_compressed":3530182,"data_compressed_allocated":33943552,"data_compressed_original":68378624,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673699,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":138040,"kb_used_data":26544,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94233800,"statfs":{"total":96636764160,"available":96495411200,"internally_reserved":0,"allocated":27181056,"data_stored":53898598,"data_compressed":2770305,"data_compressed_allocated":26583040,"data_compressed_original":53657600,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706403,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137480,"kb_used_data":25984,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94234360,"statfs":{"total":96636764160,"available":96495984640,"internally_reserved":0,"allocated":26607616,"data_stored":52310508,"data_compressed":2689231,"data_compressed_allocated":26046464,"data_compressed_original":52092928,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706402,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136940,"kb_used_data":37924,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94234900,"statfs":{"total":96636764160,"available":96496537600,"internally_reserved":0,"allocated":38834176,"data_stored":77217977,"data_compressed":3974242,"data_compressed_allocated":38244352,"data_compressed_original":76980224,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38653952,"data_stored":77307904,"data_compressed":3990805,"data_compressed_allocated":38653952,"data_compressed_original":77307904,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26066944,"data_stored":52133888,"data_compressed":2691346,"data_compressed_allocated":26066944,"data_compressed_original":52133888,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26603520,"data_stored":53207040,"data_compressed":2746683,"data_compressed_allocated":26603520,"data_compressed_original":53207040,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33914880,"data_stored":67829760,"data_compressed":3501484,"data_compressed_allocated":33914880,"data_compressed_original":67829760,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:07.212 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:07.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:07.338+0000 7f40cf39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:07.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:07.345+0000 7f40cf39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:07.553 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:40:07.562743+0000 min lat: 0.0148973 max lat: 0.456426 avg lat: 0.117897 2024-04-25T09:40:07.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:40:07.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 16 10860 10844 1.05889 0.890625 0.288744 0.117897 2024-04-25T09:40:08.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 10973 10957 1.05671 0.882812 0.0949815 0.118138 2024-04-25T09:40:09.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 11106 11090 1.05649 1.03906 0.0484688 0.118211 2024-04-25T09:40:09.572 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:09.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:09.701+0000 7f38118ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:09.700 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:09.708+0000 7f38118ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:10.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 16 11237 11221 1.05609 1.02344 0.108624 0.118204 2024-04-25T09:40:11.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 11357 11341 1.05468 0.9375 0.0916147 0.118406 2024-04-25T09:40:11.910 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:12.036 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:12.042+0000 7fb91319d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:12.042 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:12.050+0000 7fb91319d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:12.205 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:12.206 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:40:12.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:12.363+0000 7f1a0f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:12.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:12.377+0000 7f1a0f02d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:12.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 11457 11441 1.05146 0.78125 0.135896 0.118694 2024-04-25T09:40:13.464 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:40:13.483 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:40:13.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 11570 11554 1.0495 0.882812 0.120071 0.118989 2024-04-25T09:40:13.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:13.621+0000 7fcc24806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:13.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:13.634+0000 7fcc24806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:14.226 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:14.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:14.352+0000 7f62a8e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:14.352 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:14.360+0000 7f62a8e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:14.372 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:40:14.391 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:40:14.522 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:14.521+0000 7f6672c0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:14.527 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:14.534+0000 7f6672c0f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:14.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 11687 11671 1.04794 0.914062 0.352639 0.119095 2024-04-25T09:40:15.466 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:40:15.484 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:40:15.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 11799 11783 1.04598 0.875 0.137281 0.1194 2024-04-25T09:40:15.673 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:15.673+0000 7f7e44f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:15.678 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:15.686+0000 7f7e44f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:16.473 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:40:16.494 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:40:16.494 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:16.546 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:16.554 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 11926 11910 1.04537 0.992188 0.0600991 0.11943 2024-04-25T09:40:16.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:16.688+0000 7fb89bead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:16.692 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:16.700+0000 7fb89bead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:16.712 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:16.716+0000 7f0fb946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:16.720 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:16.728+0000 7f0fb946d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:16.924 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:16.924 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:16.943 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":468,"stamp":"2024-04-25T09:40:16.482454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":93602336,"num_objects":1423,"num_object_clones":0,"num_object_copies":4269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11491,"num_write_kb":92726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11436,"ondisk_log_size":11436,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":563408,"kb_used_data":138220,"kb_used_omap":0,"kb_used_meta":425152,"kb_avail":376923952,"statfs":{"total":386547056640,"available":385970126848,"internally_reserved":0,"allocated":141537280,"data_stored":280647840,"data_compressed":14438958,"data_compressed_allocated":139100160,"data_compressed_original":279674880,"omap_allocated":0,"internal_metadata":435355648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.096275"},"pg_stats":[{"pgid":"9.7","version":"94'767","reported_seq":806,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.089694+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:40:10.089694+0000","last_peered":"2024-04-25T09:40:10.089694+0000","last_clean":"2024-04-25T09:40:10.089694+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:40:10.089694+0000","last_undegraded":"2024-04-25T09:40:10.089694+0000","last_fullsized":"2024-04-25T09:40:10.089694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"94'759","reported_seq":800,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.972314+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:40:10.972314+0000","last_peered":"2024-04-25T09:40:10.972314+0000","last_clean":"2024-04-25T09:40:10.972314+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:40:10.972314+0000","last_undegraded":"2024-04-25T09:40:10.972314+0000","last_fullsized":"2024-04-25T09:40:10.972314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"93'696","reported_seq":734,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.547254+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:40:10.547254+0000","last_peered":"2024-04-25T09:40:10.547254+0000","last_clean":"2024-04-25T09:40:10.547254+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:40:10.547254+0000","last_undegraded":"2024-04-25T09:40:10.547254+0000","last_fullsized":"2024-04-25T09:40:10.547254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"94'668","reported_seq":707,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:12.449015+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:40:12.449015+0000","last_peered":"2024-04-25T09:40:12.449015+0000","last_clean":"2024-04-25T09:40:12.449015+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:40:12.449015+0000","last_undegraded":"2024-04-25T09:40:12.449015+0000","last_fullsized":"2024-04-25T09:40:12.449015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5480448,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":5352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"94'663","reported_seq":702,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.478191+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:40:11.478191+0000","last_peered":"2024-04-25T09:40:11.478191+0000","last_clean":"2024-04-25T09:40:11.478191+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:40:11.478191+0000","last_undegraded":"2024-04-25T09:40:11.478191+0000","last_fullsized":"2024-04-25T09:40:11.478191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"94'751","reported_seq":792,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.408207+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:40:11.408207+0000","last_peered":"2024-04-25T09:40:11.408207+0000","last_clean":"2024-04-25T09:40:11.408207+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:40:11.408207+0000","last_undegraded":"2024-04-25T09:40:11.408207+0000","last_fullsized":"2024-04-25T09:40:11.408207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"94'728","reported_seq":767,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.071807+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:40:11.071807+0000","last_peered":"2024-04-25T09:40:11.071807+0000","last_clean":"2024-04-25T09:40:11.071807+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:40:11.071807+0000","last_undegraded":"2024-04-25T09:40:11.071807+0000","last_fullsized":"2024-04-25T09:40:11.071807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5971968,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":5832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"94'735","reported_seq":774,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:12.132046+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:40:12.132046+0000","last_peered":"2024-04-25T09:40:12.132046+0000","last_clean":"2024-04-25T09:40:12.132046+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:40:12.132046+0000","last_undegraded":"2024-04-25T09:40:12.132046+0000","last_fullsized":"2024-04-25T09:40:12.132046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"94'751","reported_seq":790,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.935617+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:40:10.935617+0000","last_peered":"2024-04-25T09:40:10.935617+0000","last_clean":"2024-04-25T09:40:10.935617+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:40:10.935617+0000","last_undegraded":"2024-04-25T09:40:10.935617+0000","last_fullsized":"2024-04-25T09:40:10.935617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":348,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.585910+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:10.585910+0000","last_peered":"2024-04-25T09:40:10.585910+0000","last_clean":"2024-04-25T09:40:10.585910+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:10.585910+0000","last_undegraded":"2024-04-25T09:40:10.585910+0000","last_fullsized":"2024-04-25T09:40:10.585910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.551459+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:10.551459+0000","last_peered":"2024-04-25T09:40:10.551459+0000","last_clean":"2024-04-25T09:40:10.551459+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:10.551459+0000","last_undegraded":"2024-04-25T09:40:10.551459+0000","last_fullsized":"2024-04-25T09:40:10.551459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"94'655","reported_seq":694,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.288850+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:40:10.288850+0000","last_peered":"2024-04-25T09:40:10.288850+0000","last_clean":"2024-04-25T09:40:10.288850+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:40:10.288850+0000","last_undegraded":"2024-04-25T09:40:10.288850+0000","last_fullsized":"2024-04-25T09:40:10.288850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:09.432737+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:09.432737+0000","last_peered":"2024-04-25T09:40:09.432737+0000","last_clean":"2024-04-25T09:40:09.432737+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:09.432737+0000","last_undegraded":"2024-04-25T09:40:09.432737+0000","last_fullsized":"2024-04-25T09:40:09.432737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"94'743","reported_seq":782,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.629288+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:40:10.629288+0000","last_peered":"2024-04-25T09:40:10.629288+0000","last_clean":"2024-04-25T09:40:10.629288+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:40:10.629288+0000","last_undegraded":"2024-04-25T09:40:10.629288+0000","last_fullsized":"2024-04-25T09:40:10.629288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.549572+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:10.549572+0000","last_peered":"2024-04-25T09:40:10.549572+0000","last_clean":"2024-04-25T09:40:10.549572+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:10.549572+0000","last_undegraded":"2024-04-25T09:40:10.549572+0000","last_fullsized":"2024-04-25T09:40:10.549572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"94'751","reported_seq":790,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.341334+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:40:11.341334+0000","last_peered":"2024-04-25T09:40:11.341334+0000","last_clean":"2024-04-25T09:40:11.341334+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:40:11.341334+0000","last_undegraded":"2024-04-25T09:40:11.341334+0000","last_fullsized":"2024-04-25T09:40:11.341334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:09.421668+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:09.421668+0000","last_peered":"2024-04-25T09:40:09.421668+0000","last_clean":"2024-04-25T09:40:09.421668+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:09.421668+0000","last_undegraded":"2024-04-25T09:40:09.421668+0000","last_fullsized":"2024-04-25T09:40:09.421668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"94'597","reported_seq":636,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.480304+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:40:11.480304+0000","last_peered":"2024-04-25T09:40:11.480304+0000","last_clean":"2024-04-25T09:40:11.480304+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:40:11.480304+0000","last_undegraded":"2024-04-25T09:40:11.480304+0000","last_fullsized":"2024-04-25T09:40:11.480304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4898816,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":4784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.545100+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:10.545100+0000","last_peered":"2024-04-25T09:40:10.545100+0000","last_clean":"2024-04-25T09:40:10.545100+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:10.545100+0000","last_undegraded":"2024-04-25T09:40:10.545100+0000","last_fullsized":"2024-04-25T09:40:10.545100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"94'669","reported_seq":708,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.500625+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:40:11.500625+0000","last_peered":"2024-04-25T09:40:11.500625+0000","last_clean":"2024-04-25T09:40:11.500625+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:40:11.500625+0000","last_undegraded":"2024-04-25T09:40:11.500625+0000","last_fullsized":"2024-04-25T09:40:11.500625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5488640,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":5360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.597114+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:10.597114+0000","last_peered":"2024-04-25T09:40:10.597114+0000","last_clean":"2024-04-25T09:40:10.597114+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:10.597114+0000","last_undegraded":"2024-04-25T09:40:10.597114+0000","last_fullsized":"2024-04-25T09:40:10.597114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"94'695","reported_seq":734,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.183349+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:40:11.183349+0000","last_peered":"2024-04-25T09:40:11.183349+0000","last_clean":"2024-04-25T09:40:11.183349+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:40:11.183349+0000","last_undegraded":"2024-04-25T09:40:11.183349+0000","last_fullsized":"2024-04-25T09:40:11.183349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.550869+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:10.550869+0000","last_peered":"2024-04-25T09:40:10.550869+0000","last_clean":"2024-04-25T09:40:10.550869+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:10.550869+0000","last_undegraded":"2024-04-25T09:40:10.550869+0000","last_fullsized":"2024-04-25T09:40:10.550869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"94'711","reported_seq":752,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.855717+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:40:10.855717+0000","last_peered":"2024-04-25T09:40:10.855717+0000","last_clean":"2024-04-25T09:40:10.855717+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:40:10.855717+0000","last_undegraded":"2024-04-25T09:40:10.855717+0000","last_fullsized":"2024-04-25T09:40:10.855717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.550143+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:10.550143+0000","last_peered":"2024-04-25T09:40:10.550143+0000","last_clean":"2024-04-25T09:40:10.550143+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:10.550143+0000","last_undegraded":"2024-04-25T09:40:10.550143+0000","last_fullsized":"2024-04-25T09:40:10.550143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":93011968,"num_objects":1421,"num_object_clones":0,"num_object_copies":4263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11354,"num_write_kb":90832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139808768,"data_stored":279617536,"data_compressed":14434926,"data_compressed_allocated":139808768,"data_compressed_original":279617536,"omap_allocated":0,"internal_metadata":0},"log_size":11339,"ondisk_log_size":11339,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148896,"kb_used_data":37400,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94222944,"statfs":{"total":96636764160,"available":96484294656,"internally_reserved":0,"allocated":38297600,"data_stored":76105392,"data_compressed":3916381,"data_compressed_allocated":37683200,"data_compressed_original":75857920,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140740,"kb_used_data":29244,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94231100,"statfs":{"total":96636764160,"available":96492646400,"internally_reserved":0,"allocated":29945856,"data_stored":59401904,"data_compressed":3054137,"data_compressed_allocated":29331456,"data_compressed_original":59154432,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706413,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128072,"kb_used_data":29056,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94243768,"statfs":{"total":96636764160,"available":96505618432,"internally_reserved":0,"allocated":29753344,"data_stored":58549392,"data_compressed":3010710,"data_compressed_allocated":29159424,"data_compressed_original":58318848,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":145700,"kb_used_data":42520,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94226140,"statfs":{"total":96636764160,"available":96487567360,"internally_reserved":0,"allocated":43540480,"data_stored":86591152,"data_compressed":4457730,"data_compressed_allocated":42926080,"data_compressed_original":86343680,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43339776,"data_stored":86679552,"data_compressed":4474716,"data_compressed_allocated":43339776,"data_compressed_original":86679552,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29171712,"data_stored":58343424,"data_compressed":3011979,"data_compressed_allocated":29171712,"data_compressed_original":58343424,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29347840,"data_stored":58695680,"data_compressed":3030092,"data_compressed_allocated":29347840,"data_compressed_original":58695680,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37949440,"data_stored":75898880,"data_compressed":3918139,"data_compressed_allocated":37949440,"data_compressed_original":75898880,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:16.945 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:17.108 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:17.111+0000 7f2fdfc17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:17.113 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:17.120+0000 7f2fdfc17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:17.323 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:17.323 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:17.338 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":468,"stamp":"2024-04-25T09:40:16.482454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":93602336,"num_objects":1423,"num_object_clones":0,"num_object_copies":4269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11491,"num_write_kb":92726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11436,"ondisk_log_size":11436,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":563408,"kb_used_data":138220,"kb_used_omap":0,"kb_used_meta":425152,"kb_avail":376923952,"statfs":{"total":386547056640,"available":385970126848,"internally_reserved":0,"allocated":141537280,"data_stored":280647840,"data_compressed":14438958,"data_compressed_allocated":139100160,"data_compressed_original":279674880,"omap_allocated":0,"internal_metadata":435355648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.096275"},"pg_stats":[{"pgid":"9.7","version":"94'767","reported_seq":806,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.089694+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:40:10.089694+0000","last_peered":"2024-04-25T09:40:10.089694+0000","last_clean":"2024-04-25T09:40:10.089694+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:40:10.089694+0000","last_undegraded":"2024-04-25T09:40:10.089694+0000","last_fullsized":"2024-04-25T09:40:10.089694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"94'759","reported_seq":800,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.972314+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:40:10.972314+0000","last_peered":"2024-04-25T09:40:10.972314+0000","last_clean":"2024-04-25T09:40:10.972314+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:40:10.972314+0000","last_undegraded":"2024-04-25T09:40:10.972314+0000","last_fullsized":"2024-04-25T09:40:10.972314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"93'696","reported_seq":734,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.547254+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:40:10.547254+0000","last_peered":"2024-04-25T09:40:10.547254+0000","last_clean":"2024-04-25T09:40:10.547254+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:40:10.547254+0000","last_undegraded":"2024-04-25T09:40:10.547254+0000","last_fullsized":"2024-04-25T09:40:10.547254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"94'668","reported_seq":707,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:12.449015+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:40:12.449015+0000","last_peered":"2024-04-25T09:40:12.449015+0000","last_clean":"2024-04-25T09:40:12.449015+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:40:12.449015+0000","last_undegraded":"2024-04-25T09:40:12.449015+0000","last_fullsized":"2024-04-25T09:40:12.449015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5480448,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":5352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"94'663","reported_seq":702,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.478191+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:40:11.478191+0000","last_peered":"2024-04-25T09:40:11.478191+0000","last_clean":"2024-04-25T09:40:11.478191+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:40:11.478191+0000","last_undegraded":"2024-04-25T09:40:11.478191+0000","last_fullsized":"2024-04-25T09:40:11.478191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"94'751","reported_seq":792,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.408207+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:40:11.408207+0000","last_peered":"2024-04-25T09:40:11.408207+0000","last_clean":"2024-04-25T09:40:11.408207+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:40:11.408207+0000","last_undegraded":"2024-04-25T09:40:11.408207+0000","last_fullsized":"2024-04-25T09:40:11.408207+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"94'728","reported_seq":767,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.071807+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:40:11.071807+0000","last_peered":"2024-04-25T09:40:11.071807+0000","last_clean":"2024-04-25T09:40:11.071807+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:40:11.071807+0000","last_undegraded":"2024-04-25T09:40:11.071807+0000","last_fullsized":"2024-04-25T09:40:11.071807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5971968,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":5832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"94'735","reported_seq":774,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:12.132046+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:40:12.132046+0000","last_peered":"2024-04-25T09:40:12.132046+0000","last_clean":"2024-04-25T09:40:12.132046+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:40:12.132046+0000","last_undegraded":"2024-04-25T09:40:12.132046+0000","last_fullsized":"2024-04-25T09:40:12.132046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"94'751","reported_seq":790,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.935617+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:40:10.935617+0000","last_peered":"2024-04-25T09:40:10.935617+0000","last_clean":"2024-04-25T09:40:10.935617+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:40:10.935617+0000","last_undegraded":"2024-04-25T09:40:10.935617+0000","last_fullsized":"2024-04-25T09:40:10.935617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":348,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.585910+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:10.585910+0000","last_peered":"2024-04-25T09:40:10.585910+0000","last_clean":"2024-04-25T09:40:10.585910+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:10.585910+0000","last_undegraded":"2024-04-25T09:40:10.585910+0000","last_fullsized":"2024-04-25T09:40:10.585910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.551459+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:10.551459+0000","last_peered":"2024-04-25T09:40:10.551459+0000","last_clean":"2024-04-25T09:40:10.551459+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:10.551459+0000","last_undegraded":"2024-04-25T09:40:10.551459+0000","last_fullsized":"2024-04-25T09:40:10.551459+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"94'655","reported_seq":694,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.288850+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:40:10.288850+0000","last_peered":"2024-04-25T09:40:10.288850+0000","last_clean":"2024-04-25T09:40:10.288850+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:40:10.288850+0000","last_undegraded":"2024-04-25T09:40:10.288850+0000","last_fullsized":"2024-04-25T09:40:10.288850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:09.432737+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:09.432737+0000","last_peered":"2024-04-25T09:40:09.432737+0000","last_clean":"2024-04-25T09:40:09.432737+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:09.432737+0000","last_undegraded":"2024-04-25T09:40:09.432737+0000","last_fullsized":"2024-04-25T09:40:09.432737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"94'743","reported_seq":782,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.629288+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:40:10.629288+0000","last_peered":"2024-04-25T09:40:10.629288+0000","last_clean":"2024-04-25T09:40:10.629288+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:40:10.629288+0000","last_undegraded":"2024-04-25T09:40:10.629288+0000","last_fullsized":"2024-04-25T09:40:10.629288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.549572+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:10.549572+0000","last_peered":"2024-04-25T09:40:10.549572+0000","last_clean":"2024-04-25T09:40:10.549572+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:10.549572+0000","last_undegraded":"2024-04-25T09:40:10.549572+0000","last_fullsized":"2024-04-25T09:40:10.549572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"94'751","reported_seq":790,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.341334+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:40:11.341334+0000","last_peered":"2024-04-25T09:40:11.341334+0000","last_clean":"2024-04-25T09:40:11.341334+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:40:11.341334+0000","last_undegraded":"2024-04-25T09:40:11.341334+0000","last_fullsized":"2024-04-25T09:40:11.341334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:09.421668+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:09.421668+0000","last_peered":"2024-04-25T09:40:09.421668+0000","last_clean":"2024-04-25T09:40:09.421668+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:09.421668+0000","last_undegraded":"2024-04-25T09:40:09.421668+0000","last_fullsized":"2024-04-25T09:40:09.421668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"94'597","reported_seq":636,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.480304+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:40:11.480304+0000","last_peered":"2024-04-25T09:40:11.480304+0000","last_clean":"2024-04-25T09:40:11.480304+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:40:11.480304+0000","last_undegraded":"2024-04-25T09:40:11.480304+0000","last_fullsized":"2024-04-25T09:40:11.480304+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4898816,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":4784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.545100+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:10.545100+0000","last_peered":"2024-04-25T09:40:10.545100+0000","last_clean":"2024-04-25T09:40:10.545100+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:10.545100+0000","last_undegraded":"2024-04-25T09:40:10.545100+0000","last_fullsized":"2024-04-25T09:40:10.545100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"94'669","reported_seq":708,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.500625+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:40:11.500625+0000","last_peered":"2024-04-25T09:40:11.500625+0000","last_clean":"2024-04-25T09:40:11.500625+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:40:11.500625+0000","last_undegraded":"2024-04-25T09:40:11.500625+0000","last_fullsized":"2024-04-25T09:40:11.500625+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5488640,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":670,"num_write_kb":5360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.597114+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:10.597114+0000","last_peered":"2024-04-25T09:40:10.597114+0000","last_clean":"2024-04-25T09:40:10.597114+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:10.597114+0000","last_undegraded":"2024-04-25T09:40:10.597114+0000","last_fullsized":"2024-04-25T09:40:10.597114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"94'695","reported_seq":734,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.183349+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:40:11.183349+0000","last_peered":"2024-04-25T09:40:11.183349+0000","last_clean":"2024-04-25T09:40:11.183349+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:40:11.183349+0000","last_undegraded":"2024-04-25T09:40:11.183349+0000","last_fullsized":"2024-04-25T09:40:11.183349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.550869+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:10.550869+0000","last_peered":"2024-04-25T09:40:10.550869+0000","last_clean":"2024-04-25T09:40:10.550869+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:10.550869+0000","last_undegraded":"2024-04-25T09:40:10.550869+0000","last_fullsized":"2024-04-25T09:40:10.550869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"94'711","reported_seq":752,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.855717+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:40:10.855717+0000","last_peered":"2024-04-25T09:40:10.855717+0000","last_clean":"2024-04-25T09:40:10.855717+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:40:10.855717+0000","last_undegraded":"2024-04-25T09:40:10.855717+0000","last_fullsized":"2024-04-25T09:40:10.855717+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":213,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.550143+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:10.550143+0000","last_peered":"2024-04-25T09:40:10.550143+0000","last_clean":"2024-04-25T09:40:10.550143+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:10.550143+0000","last_undegraded":"2024-04-25T09:40:10.550143+0000","last_fullsized":"2024-04-25T09:40:10.550143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":93011968,"num_objects":1421,"num_object_clones":0,"num_object_copies":4263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11354,"num_write_kb":90832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139808768,"data_stored":279617536,"data_compressed":14434926,"data_compressed_allocated":139808768,"data_compressed_original":279617536,"omap_allocated":0,"internal_metadata":0},"log_size":11339,"ondisk_log_size":11339,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148896,"kb_used_data":37400,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94222944,"statfs":{"total":96636764160,"available":96484294656,"internally_reserved":0,"allocated":38297600,"data_stored":76105392,"data_compressed":3916381,"data_compressed_allocated":37683200,"data_compressed_original":75857920,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140740,"kb_used_data":29244,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94231100,"statfs":{"total":96636764160,"available":96492646400,"internally_reserved":0,"allocated":29945856,"data_stored":59401904,"data_compressed":3054137,"data_compressed_allocated":29331456,"data_compressed_original":59154432,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706413,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128072,"kb_used_data":29056,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94243768,"statfs":{"total":96636764160,"available":96505618432,"internally_reserved":0,"allocated":29753344,"data_stored":58549392,"data_compressed":3010710,"data_compressed_allocated":29159424,"data_compressed_original":58318848,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":145700,"kb_used_data":42520,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94226140,"statfs":{"total":96636764160,"available":96487567360,"internally_reserved":0,"allocated":43540480,"data_stored":86591152,"data_compressed":4457730,"data_compressed_allocated":42926080,"data_compressed_original":86343680,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43339776,"data_stored":86679552,"data_compressed":4474716,"data_compressed_allocated":43339776,"data_compressed_original":86679552,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29171712,"data_stored":58343424,"data_compressed":3011979,"data_compressed_allocated":29171712,"data_compressed_original":58343424,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29347840,"data_stored":58695680,"data_compressed":3030092,"data_compressed_allocated":29347840,"data_compressed_original":58695680,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37949440,"data_stored":75898880,"data_compressed":3918139,"data_compressed_allocated":37949440,"data_compressed_original":75898880,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:17.340 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:40:17.340 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:17.340 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:17.460 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:17.463+0000 7f802035d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:17.465 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:17.473+0000 7f802035d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:17.555 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 16 12027 12011 1.04252 0.789062 0.0696179 0.119761 2024-04-25T09:40:17.671 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:17.672 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:17.685 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":469,"stamp":"2024-04-25T09:40:17.387643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":96322080,"num_objects":1464,"num_object_clones":0,"num_object_copies":4392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11823,"num_write_kb":95382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11768,"ondisk_log_size":11768,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":571472,"kb_used_data":142128,"kb_used_omap":0,"kb_used_meta":429312,"kb_avail":376915888,"statfs":{"total":386547056640,"available":385961869312,"internally_reserved":0,"allocated":145539072,"data_stored":288598868,"data_compressed":14848845,"data_compressed_allocated":143069184,"data_compressed_original":287612928,"omap_allocated":0,"internal_metadata":439615488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2719744,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000982"},"pg_stats":[{"pgid":"9.7","version":"96'835","reported_seq":878,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.513549+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:40:16.513549+0000","last_peered":"2024-04-25T09:40:16.513549+0000","last_clean":"2024-04-25T09:40:16.513549+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:40:16.513549+0000","last_undegraded":"2024-04-25T09:40:16.513549+0000","last_fullsized":"2024-04-25T09:40:16.513549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848512,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"96'783","reported_seq":828,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.922524+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:40:15.922524+0000","last_peered":"2024-04-25T09:40:15.922524+0000","last_clean":"2024-04-25T09:40:15.922524+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:40:15.922524+0000","last_undegraded":"2024-04-25T09:40:15.922524+0000","last_fullsized":"2024-04-25T09:40:15.922524+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"93'696","reported_seq":734,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.547254+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:40:10.547254+0000","last_peered":"2024-04-25T09:40:10.547254+0000","last_clean":"2024-04-25T09:40:10.547254+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:40:10.547254+0000","last_undegraded":"2024-04-25T09:40:10.547254+0000","last_fullsized":"2024-04-25T09:40:10.547254+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"94'668","reported_seq":707,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:12.449015+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:40:12.449015+0000","last_peered":"2024-04-25T09:40:12.449015+0000","last_clean":"2024-04-25T09:40:12.449015+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:40:12.449015+0000","last_undegraded":"2024-04-25T09:40:12.449015+0000","last_fullsized":"2024-04-25T09:40:12.449015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5480448,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":5352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"94'663","reported_seq":702,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.478191+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:40:11.478191+0000","last_peered":"2024-04-25T09:40:11.478191+0000","last_clean":"2024-04-25T09:40:11.478191+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:40:11.478191+0000","last_undegraded":"2024-04-25T09:40:11.478191+0000","last_fullsized":"2024-04-25T09:40:11.478191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"96'783","reported_seq":828,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.897428+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:40:15.897428+0000","last_peered":"2024-04-25T09:40:15.897428+0000","last_clean":"2024-04-25T09:40:15.897428+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:40:15.897428+0000","last_undegraded":"2024-04-25T09:40:15.897428+0000","last_fullsized":"2024-04-25T09:40:15.897428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"96'775","reported_seq":818,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.147734+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:40:16.147734+0000","last_peered":"2024-04-25T09:40:16.147734+0000","last_clean":"2024-04-25T09:40:16.147734+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:40:16.147734+0000","last_undegraded":"2024-04-25T09:40:16.147734+0000","last_fullsized":"2024-04-25T09:40:16.147734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"94'735","reported_seq":774,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:12.132046+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:40:12.132046+0000","last_peered":"2024-04-25T09:40:12.132046+0000","last_clean":"2024-04-25T09:40:12.132046+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:40:12.132046+0000","last_undegraded":"2024-04-25T09:40:12.132046+0000","last_fullsized":"2024-04-25T09:40:12.132046+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"94'751","reported_seq":790,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.935617+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:40:10.935617+0000","last_peered":"2024-04-25T09:40:10.935617+0000","last_clean":"2024-04-25T09:40:10.935617+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:40:10.935617+0000","last_undegraded":"2024-04-25T09:40:10.935617+0000","last_fullsized":"2024-04-25T09:40:10.935617+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":348,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.585910+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:10.585910+0000","last_peered":"2024-04-25T09:40:10.585910+0000","last_clean":"2024-04-25T09:40:10.585910+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:10.585910+0000","last_undegraded":"2024-04-25T09:40:10.585910+0000","last_fullsized":"2024-04-25T09:40:10.585910+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.759467+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:14.759467+0000","last_peered":"2024-04-25T09:40:14.759467+0000","last_clean":"2024-04-25T09:40:14.759467+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:14.759467+0000","last_undegraded":"2024-04-25T09:40:14.759467+0000","last_fullsized":"2024-04-25T09:40:14.759467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"96'679","reported_seq":722,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.251582+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:40:15.251582+0000","last_peered":"2024-04-25T09:40:15.251582+0000","last_clean":"2024-04-25T09:40:15.251582+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:40:15.251582+0000","last_undegraded":"2024-04-25T09:40:15.251582+0000","last_fullsized":"2024-04-25T09:40:15.251582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.781987+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:14.781987+0000","last_peered":"2024-04-25T09:40:14.781987+0000","last_clean":"2024-04-25T09:40:14.781987+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:14.781987+0000","last_undegraded":"2024-04-25T09:40:14.781987+0000","last_fullsized":"2024-04-25T09:40:14.781987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"94'743","reported_seq":782,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.629288+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:40:10.629288+0000","last_peered":"2024-04-25T09:40:10.629288+0000","last_clean":"2024-04-25T09:40:10.629288+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:40:10.629288+0000","last_undegraded":"2024-04-25T09:40:10.629288+0000","last_fullsized":"2024-04-25T09:40:10.629288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.732532+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:14.732532+0000","last_peered":"2024-04-25T09:40:14.732532+0000","last_clean":"2024-04-25T09:40:14.732532+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:14.732532+0000","last_undegraded":"2024-04-25T09:40:14.732532+0000","last_fullsized":"2024-04-25T09:40:14.732532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"94'751","reported_seq":790,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.341334+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:40:11.341334+0000","last_peered":"2024-04-25T09:40:11.341334+0000","last_clean":"2024-04-25T09:40:11.341334+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:40:11.341334+0000","last_undegraded":"2024-04-25T09:40:11.341334+0000","last_fullsized":"2024-04-25T09:40:11.341334+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.765309+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:14.765309+0000","last_peered":"2024-04-25T09:40:14.765309+0000","last_clean":"2024-04-25T09:40:14.765309+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:14.765309+0000","last_undegraded":"2024-04-25T09:40:14.765309+0000","last_fullsized":"2024-04-25T09:40:14.765309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"96'671","reported_seq":714,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.820501+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:40:15.820501+0000","last_peered":"2024-04-25T09:40:15.820501+0000","last_clean":"2024-04-25T09:40:15.820501+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:40:15.820501+0000","last_undegraded":"2024-04-25T09:40:15.820501+0000","last_fullsized":"2024-04-25T09:40:15.820501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.545100+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:10.545100+0000","last_peered":"2024-04-25T09:40:10.545100+0000","last_clean":"2024-04-25T09:40:10.545100+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:10.545100+0000","last_undegraded":"2024-04-25T09:40:10.545100+0000","last_fullsized":"2024-04-25T09:40:10.545100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"96'703","reported_seq":746,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.467146+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:40:16.467146+0000","last_peered":"2024-04-25T09:40:16.467146+0000","last_clean":"2024-04-25T09:40:16.467146+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:40:16.467146+0000","last_undegraded":"2024-04-25T09:40:16.467146+0000","last_fullsized":"2024-04-25T09:40:16.467146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.597114+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:10.597114+0000","last_peered":"2024-04-25T09:40:10.597114+0000","last_clean":"2024-04-25T09:40:10.597114+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:10.597114+0000","last_undegraded":"2024-04-25T09:40:10.597114+0000","last_fullsized":"2024-04-25T09:40:10.597114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"94'695","reported_seq":734,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:11.183349+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:40:11.183349+0000","last_peered":"2024-04-25T09:40:11.183349+0000","last_clean":"2024-04-25T09:40:11.183349+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:40:11.183349+0000","last_undegraded":"2024-04-25T09:40:11.183349+0000","last_fullsized":"2024-04-25T09:40:11.183349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-25T09:40:10.550869+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:10.550869+0000","last_peered":"2024-04-25T09:40:10.550869+0000","last_clean":"2024-04-25T09:40:10.550869+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:10.550869+0000","last_undegraded":"2024-04-25T09:40:10.550869+0000","last_fullsized":"2024-04-25T09:40:10.550869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"96'740","reported_seq":785,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.462611+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:40:16.462611+0000","last_peered":"2024-04-25T09:40:16.462611+0000","last_clean":"2024-04-25T09:40:16.462611+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:40:16.462611+0000","last_undegraded":"2024-04-25T09:40:16.462611+0000","last_fullsized":"2024-04-25T09:40:16.462611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6070272,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":741,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.763544+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:14.763544+0000","last_peered":"2024-04-25T09:40:14.763544+0000","last_clean":"2024-04-25T09:40:14.763544+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:14.763544+0000","last_undegraded":"2024-04-25T09:40:14.763544+0000","last_fullsized":"2024-04-25T09:40:14.763544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":95731712,"num_objects":1462,"num_object_clones":0,"num_object_copies":4386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11686,"num_write_kb":93488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143810560,"data_stored":287621120,"data_compressed":14848197,"data_compressed_allocated":143810560,"data_compressed_original":287621120,"omap_allocated":0,"internal_metadata":0},"log_size":11671,"ondisk_log_size":11671,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148896,"kb_used_data":37400,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94222944,"statfs":{"total":96636764160,"available":96484294656,"internally_reserved":0,"allocated":38297600,"data_stored":76105392,"data_compressed":3916381,"data_compressed_allocated":37683200,"data_compressed_original":75857920,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673709,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140740,"kb_used_data":29244,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94231100,"statfs":{"total":96636764160,"available":96492646400,"internally_reserved":0,"allocated":29945856,"data_stored":59401904,"data_compressed":3054137,"data_compressed_allocated":29331456,"data_compressed_original":59154432,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129800,"kb_used_data":30784,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94242040,"statfs":{"total":96636764160,"available":96503848960,"internally_reserved":0,"allocated":31522816,"data_stored":62062058,"data_compressed":3191754,"data_compressed_allocated":30912512,"data_compressed_original":61825024,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706417,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":152036,"kb_used_data":44700,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94219804,"statfs":{"total":96636764160,"available":96481079296,"internally_reserved":0,"allocated":45772800,"data_stored":91029514,"data_compressed":4686573,"data_compressed_allocated":45142016,"data_compressed_original":90775552,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45584384,"data_stored":91168768,"data_compressed":4706520,"data_compressed_allocated":45584384,"data_compressed_original":91168768,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30928896,"data_stored":61857792,"data_compressed":3193446,"data_compressed_allocated":30928896,"data_compressed_original":61857792,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29347840,"data_stored":58695680,"data_compressed":3030092,"data_compressed_allocated":29347840,"data_compressed_original":58695680,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37949440,"data_stored":75898880,"data_compressed":3918139,"data_compressed_allocated":37949440,"data_compressed_original":75898880,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:18.555 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1342 2024-04-25T09:40:18.555 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 12027 2024-04-25T09:40:18.555 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:40:18.555 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:40:18.555 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.04246 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.0986556 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.26562 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.78125 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 133 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 12.6279 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 162 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 100 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.119816 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.06142 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.603767 2024-04-25T09:40:18.556 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0148973 2024-04-25T09:40:18.582 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:40:18.927 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:19.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:19.058+0000 7efe9819d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:19.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:19.064+0000 7efe9819d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:21.317 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:21.453 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:21.459+0000 7f581ab9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:21.457 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:21.465+0000 7f581ab9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:22.688 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:22.688 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:22.688 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:22.819 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:22.820+0000 7f9239a17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:22.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:22.830+0000 7f9239a17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:23.039 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:23.039 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:23.061 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":472,"stamp":"2024-04-25T09:40:21.388445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":98435616,"num_objects":1497,"num_object_clones":0,"num_object_copies":4491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":12081,"num_write_kb":97446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12028,"ondisk_log_size":12028,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":596728,"kb_used_data":145176,"kb_used_omap":0,"kb_used_meta":451520,"kb_avail":376890632,"statfs":{"total":386547056640,"available":385936007168,"internally_reserved":0,"allocated":148660224,"data_stored":294736060,"data_compressed":15164403,"data_compressed_allocated":146124800,"data_compressed_original":293724160,"omap_allocated":0,"internal_metadata":462356480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4833280,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":4720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001240"},"pg_stats":[{"pgid":"9.7","version":"96'835","reported_seq":878,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.513549+0000","last_change":"2024-04-25T09:38:46.804159+0000","last_active":"2024-04-25T09:40:16.513549+0000","last_peered":"2024-04-25T09:40:16.513549+0000","last_clean":"2024-04-25T09:40:16.513549+0000","last_became_active":"2024-04-25T09:38:46.796641+0000","last_became_peered":"2024-04-25T09:38:46.796641+0000","last_unstale":"2024-04-25T09:40:16.513549+0000","last_undegraded":"2024-04-25T09:40:16.513549+0000","last_fullsized":"2024-04-25T09:40:16.513549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6848512,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"96'783","reported_seq":828,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.922524+0000","last_change":"2024-04-25T09:38:46.666127+0000","last_active":"2024-04-25T09:40:15.922524+0000","last_peered":"2024-04-25T09:40:15.922524+0000","last_clean":"2024-04-25T09:40:15.922524+0000","last_became_active":"2024-04-25T09:38:46.650839+0000","last_became_peered":"2024-04-25T09:38:46.650839+0000","last_unstale":"2024-04-25T09:40:15.922524+0000","last_undegraded":"2024-04-25T09:40:15.922524+0000","last_fullsized":"2024-04-25T09:40:15.922524+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"98'735","reported_seq":784,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.966514+0000","last_change":"2024-04-25T09:38:46.653444+0000","last_active":"2024-04-25T09:40:16.966514+0000","last_peered":"2024-04-25T09:40:16.966514+0000","last_clean":"2024-04-25T09:40:16.966514+0000","last_became_active":"2024-04-25T09:38:46.643441+0000","last_became_peered":"2024-04-25T09:38:46.643441+0000","last_unstale":"2024-04-25T09:40:16.966514+0000","last_undegraded":"2024-04-25T09:40:16.966514+0000","last_fullsized":"2024-04-25T09:40:16.966514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":735,"log_dups_size":0,"ondisk_log_size":735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029312,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":736,"num_write_kb":5888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"97'696","reported_seq":745,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.608278+0000","last_change":"2024-04-25T09:38:46.657756+0000","last_active":"2024-04-25T09:40:16.608278+0000","last_peered":"2024-04-25T09:40:16.608278+0000","last_clean":"2024-04-25T09:40:16.608278+0000","last_became_active":"2024-04-25T09:38:46.649409+0000","last_became_peered":"2024-04-25T09:38:46.649409+0000","last_unstale":"2024-04-25T09:40:16.608278+0000","last_undegraded":"2024-04-25T09:40:16.608278+0000","last_fullsized":"2024-04-25T09:40:16.608278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5709824,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":697,"num_write_kb":5576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"96'687","reported_seq":736,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.535888+0000","last_change":"2024-04-25T09:38:46.731067+0000","last_active":"2024-04-25T09:40:16.535888+0000","last_peered":"2024-04-25T09:40:16.535888+0000","last_clean":"2024-04-25T09:40:16.535888+0000","last_became_active":"2024-04-25T09:38:46.724866+0000","last_became_peered":"2024-04-25T09:38:46.724866+0000","last_unstale":"2024-04-25T09:40:16.535888+0000","last_undegraded":"2024-04-25T09:40:16.535888+0000","last_fullsized":"2024-04-25T09:40:16.535888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"96'783","reported_seq":828,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.897428+0000","last_change":"2024-04-25T09:38:46.686223+0000","last_active":"2024-04-25T09:40:15.897428+0000","last_peered":"2024-04-25T09:40:15.897428+0000","last_clean":"2024-04-25T09:40:15.897428+0000","last_became_active":"2024-04-25T09:38:46.679885+0000","last_became_peered":"2024-04-25T09:38:46.679885+0000","last_unstale":"2024-04-25T09:40:15.897428+0000","last_undegraded":"2024-04-25T09:40:15.897428+0000","last_fullsized":"2024-04-25T09:40:15.897428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"96'775","reported_seq":818,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.147734+0000","last_change":"2024-04-25T09:38:46.772326+0000","last_active":"2024-04-25T09:40:16.147734+0000","last_peered":"2024-04-25T09:40:16.147734+0000","last_clean":"2024-04-25T09:40:16.147734+0000","last_became_active":"2024-04-25T09:38:46.763228+0000","last_became_peered":"2024-04-25T09:38:46.763228+0000","last_unstale":"2024-04-25T09:40:16.147734+0000","last_undegraded":"2024-04-25T09:40:16.147734+0000","last_fullsized":"2024-04-25T09:40:16.147734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.0","version":"98'799","reported_seq":848,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:17.285554+0000","last_change":"2024-04-25T09:38:46.741896+0000","last_active":"2024-04-25T09:40:17.285554+0000","last_peered":"2024-04-25T09:40:17.285554+0000","last_clean":"2024-04-25T09:40:17.285554+0000","last_became_active":"2024-04-25T09:38:46.716554+0000","last_became_peered":"2024-04-25T09:38:46.716554+0000","last_unstale":"2024-04-25T09:40:17.285554+0000","last_undegraded":"2024-04-25T09:40:17.285554+0000","last_fullsized":"2024-04-25T09:40:17.285554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"96'792","reported_seq":840,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.516927+0000","last_change":"2024-04-25T09:38:46.667642+0000","last_active":"2024-04-25T09:40:16.516927+0000","last_peered":"2024-04-25T09:40:16.516927+0000","last_clean":"2024-04-25T09:40:16.516927+0000","last_became_active":"2024-04-25T09:38:46.659466+0000","last_became_peered":"2024-04-25T09:38:46.659466+0000","last_unstale":"2024-04-25T09:40:16.516927+0000","last_undegraded":"2024-04-25T09:40:16.516927+0000","last_fullsized":"2024-04-25T09:40:16.516927+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":358,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.526277+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:16.526277+0000","last_peered":"2024-04-25T09:40:16.526277+0000","last_clean":"2024-04-25T09:40:16.526277+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:16.526277+0000","last_undegraded":"2024-04-25T09:40:16.526277+0000","last_fullsized":"2024-04-25T09:40:16.526277+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.759467+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:14.759467+0000","last_peered":"2024-04-25T09:40:14.759467+0000","last_clean":"2024-04-25T09:40:14.759467+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:14.759467+0000","last_undegraded":"2024-04-25T09:40:14.759467+0000","last_fullsized":"2024-04-25T09:40:14.759467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"96'679","reported_seq":722,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.251582+0000","last_change":"2024-04-25T09:38:46.732573+0000","last_active":"2024-04-25T09:40:15.251582+0000","last_peered":"2024-04-25T09:40:15.251582+0000","last_clean":"2024-04-25T09:40:15.251582+0000","last_became_active":"2024-04-25T09:38:46.723001+0000","last_became_peered":"2024-04-25T09:38:46.723001+0000","last_unstale":"2024-04-25T09:40:15.251582+0000","last_undegraded":"2024-04-25T09:40:15.251582+0000","last_fullsized":"2024-04-25T09:40:15.251582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":5440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.781987+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:14.781987+0000","last_peered":"2024-04-25T09:40:14.781987+0000","last_clean":"2024-04-25T09:40:14.781987+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:14.781987+0000","last_undegraded":"2024-04-25T09:40:14.781987+0000","last_fullsized":"2024-04-25T09:40:14.781987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"98'765","reported_seq":814,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:17.460310+0000","last_change":"2024-04-25T09:38:46.598962+0000","last_active":"2024-04-25T09:40:17.460310+0000","last_peered":"2024-04-25T09:40:17.460310+0000","last_clean":"2024-04-25T09:40:17.460310+0000","last_became_active":"2024-04-25T09:38:46.593530+0000","last_became_peered":"2024-04-25T09:38:46.593530+0000","last_unstale":"2024-04-25T09:40:17.460310+0000","last_undegraded":"2024-04-25T09:40:17.460310+0000","last_fullsized":"2024-04-25T09:40:17.460310+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6275072,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":6128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.732532+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:14.732532+0000","last_peered":"2024-04-25T09:40:14.732532+0000","last_clean":"2024-04-25T09:40:14.732532+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:14.732532+0000","last_undegraded":"2024-04-25T09:40:14.732532+0000","last_fullsized":"2024-04-25T09:40:14.732532+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"96'768","reported_seq":816,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.540481+0000","last_change":"2024-04-25T09:38:46.754102+0000","last_active":"2024-04-25T09:40:16.540481+0000","last_peered":"2024-04-25T09:40:16.540481+0000","last_clean":"2024-04-25T09:40:16.540481+0000","last_became_active":"2024-04-25T09:38:46.748219+0000","last_became_peered":"2024-04-25T09:38:46.748219+0000","last_unstale":"2024-04-25T09:40:16.540481+0000","last_undegraded":"2024-04-25T09:40:16.540481+0000","last_fullsized":"2024-04-25T09:40:16.540481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.765309+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:14.765309+0000","last_peered":"2024-04-25T09:40:14.765309+0000","last_clean":"2024-04-25T09:40:14.765309+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:14.765309+0000","last_undegraded":"2024-04-25T09:40:14.765309+0000","last_fullsized":"2024-04-25T09:40:14.765309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"96'671","reported_seq":714,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:15.820501+0000","last_change":"2024-04-25T09:38:46.765731+0000","last_active":"2024-04-25T09:40:15.820501+0000","last_peered":"2024-04-25T09:40:15.820501+0000","last_clean":"2024-04-25T09:40:15.820501+0000","last_became_active":"2024-04-25T09:38:46.761855+0000","last_became_peered":"2024-04-25T09:38:46.761855+0000","last_unstale":"2024-04-25T09:40:15.820501+0000","last_undegraded":"2024-04-25T09:40:15.820501+0000","last_fullsized":"2024-04-25T09:40:15.820501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":225,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.614642+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:16.614642+0000","last_peered":"2024-04-25T09:40:16.614642+0000","last_clean":"2024-04-25T09:40:16.614642+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:16.614642+0000","last_undegraded":"2024-04-25T09:40:16.614642+0000","last_fullsized":"2024-04-25T09:40:16.614642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.e","version":"96'703","reported_seq":746,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.467146+0000","last_change":"2024-04-25T09:38:46.715341+0000","last_active":"2024-04-25T09:40:16.467146+0000","last_peered":"2024-04-25T09:40:16.467146+0000","last_clean":"2024-04-25T09:40:16.467146+0000","last_became_active":"2024-04-25T09:38:46.704050+0000","last_became_peered":"2024-04-25T09:38:46.704050+0000","last_unstale":"2024-04-25T09:40:16.467146+0000","last_undegraded":"2024-04-25T09:40:16.467146+0000","last_fullsized":"2024-04-25T09:40:16.467146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":225,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.532950+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:16.532950+0000","last_peered":"2024-04-25T09:40:16.532950+0000","last_clean":"2024-04-25T09:40:16.532950+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:16.532950+0000","last_undegraded":"2024-04-25T09:40:16.532950+0000","last_fullsized":"2024-04-25T09:40:16.532950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"94'720","reported_seq":768,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.528022+0000","last_change":"2024-04-25T09:38:46.700397+0000","last_active":"2024-04-25T09:40:16.528022+0000","last_peered":"2024-04-25T09:40:16.528022+0000","last_clean":"2024-04-25T09:40:16.528022+0000","last_became_active":"2024-04-25T09:38:46.692104+0000","last_became_peered":"2024-04-25T09:38:46.692104+0000","last_unstale":"2024-04-25T09:40:16.528022+0000","last_undegraded":"2024-04-25T09:40:16.528022+0000","last_fullsized":"2024-04-25T09:40:16.528022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":225,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.615116+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:16.615116+0000","last_peered":"2024-04-25T09:40:16.615116+0000","last_clean":"2024-04-25T09:40:16.615116+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:16.615116+0000","last_undegraded":"2024-04-25T09:40:16.615116+0000","last_fullsized":"2024-04-25T09:40:16.615116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.c","version":"96'740","reported_seq":785,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:16.462611+0000","last_change":"2024-04-25T09:38:46.658316+0000","last_active":"2024-04-25T09:40:16.462611+0000","last_peered":"2024-04-25T09:40:16.462611+0000","last_clean":"2024-04-25T09:40:16.462611+0000","last_became_active":"2024-04-25T09:38:46.641519+0000","last_became_peered":"2024-04-25T09:38:46.641519+0000","last_unstale":"2024-04-25T09:40:16.462611+0000","last_undegraded":"2024-04-25T09:40:16.462611+0000","last_fullsized":"2024-04-25T09:40:16.462611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:38:45.459961+0000","last_clean_scrub_stamp":"2024-04-25T09:38:45.459961+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6070272,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":741,"num_write_kb":5928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-25T09:40:14.763544+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:14.763544+0000","last_peered":"2024-04-25T09:40:14.763544+0000","last_clean":"2024-04-25T09:40:14.763544+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:14.763544+0000","last_undegraded":"2024-04-25T09:40:14.763544+0000","last_fullsized":"2024-04-25T09:40:14.763544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":97845248,"num_objects":1495,"num_object_clones":0,"num_object_copies":4485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11944,"num_write_kb":95552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146878464,"data_stored":293756928,"data_compressed":15165024,"data_compressed_allocated":146878464,"data_compressed_original":293756928,"omap_allocated":0,"internal_metadata":0},"log_size":11931,"ondisk_log_size":11931,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":168764,"kb_used_data":39220,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94203076,"statfs":{"total":96636764160,"available":96463949824,"internally_reserved":0,"allocated":40161280,"data_stored":79780196,"data_compressed":4105462,"data_compressed_allocated":39514112,"data_compressed_original":79519744,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673714,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":146128,"kb_used_data":30472,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94225712,"statfs":{"total":96636764160,"available":96487129088,"internally_reserved":0,"allocated":31203328,"data_stored":61864292,"data_compressed":3180614,"data_compressed_allocated":30556160,"data_compressed_original":61603840,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129800,"kb_used_data":30784,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94242040,"statfs":{"total":96636764160,"available":96503848960,"internally_reserved":0,"allocated":31522816,"data_stored":62062058,"data_compressed":3191754,"data_compressed_allocated":30912512,"data_compressed_original":61825024,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706417,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":152036,"kb_used_data":44700,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94219804,"statfs":{"total":96636764160,"available":96481079296,"internally_reserved":0,"allocated":45772800,"data_stored":91029514,"data_compressed":4686573,"data_compressed_allocated":45142016,"data_compressed_original":90775552,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45584384,"data_stored":91168768,"data_compressed":4706520,"data_compressed_allocated":45584384,"data_compressed_original":91168768,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30928896,"data_stored":61857792,"data_compressed":3193446,"data_compressed_allocated":30928896,"data_compressed_original":61857792,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30572544,"data_stored":61145088,"data_compressed":3156569,"data_compressed_allocated":30572544,"data_compressed_original":61145088,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":39792640,"data_stored":79585280,"data_compressed":4108489,"data_compressed_allocated":39792640,"data_compressed_original":79585280,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:23.719 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:23.851 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:23.856+0000 7faeb5b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:23.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:23.864+0000 7faeb5b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:26.114 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:26.259 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:26.264+0000 7fac9862d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:26.264 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:26.271+0000 7fac9862d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.064 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:28.064 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:28.065 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:40:28.065 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:40:28.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.206+0000 7f462cc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.213 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.220+0000 7f462cc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.294 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:40:28.294 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:40:28.294 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:40:28.294 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:40:28.294 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:40:28.295 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:40:28.295 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:40:28.295 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:40:28.295 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:40:28.295 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:40:28.295 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:40:28.295 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:40:28.297 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:40:28.297 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:40:28.297 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:40:28.424 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.426+0000 7fd2efcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.428 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.436+0000 7fd2efcad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:40:28.446 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:40:28.447 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:40:28.447 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:40:28.447 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:40:28.447 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:40:28.451 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:40:28.451 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:40:28.451 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:40:28.578 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:28.607 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.605+0000 7ffa5d0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.613 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.620+0000 7ffa5d0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:40:28.681 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:40:28.682 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:40:28.682 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:40:28.682 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:40:28.685 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:40:28.685 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:40:28.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:40:28.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.738+0000 7f449651d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.747+0000 7f449651d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.861 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.862+0000 7f6bd1b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.867 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:28.874+0000 7f6bd1b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:40:28.890 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:40:28.891 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:40:28.891 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:40:28.893 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:40:28.894 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:40:29.594 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1504 objects 2024-04-25T09:40:29.594 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :11.0116 2024-04-25T09:40:30.967 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:31.076 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:31.082+0000 7f5778e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:31.080 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:31.087+0000 7f5778e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:31.204 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_6 2024-04-25T09:40:31.205 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2024-04-25T09:40:31.318 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:31.316+0000 7fb464d1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:31.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:31.329+0000 7fb464d1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:32.142 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_6' removed 2024-04-25T09:40:32.156 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-04-25T09:40:32.157 INFO:tasks.radosbench:Beginning radosbench... 2024-04-25T09:40:32.157 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_7 2024-04-25T09:40:32.158 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_7 16 2024-04-25T09:40:32.288 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:32.287+0000 7fc5cf6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:32.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:32.300+0000 7fc5cf6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:33.144 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_7' created 2024-04-25T09:40:33.161 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2024-04-25T09:40:33.176 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:33.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:33.303+0000 7fedb526d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:33.321 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:33.328+0000 7fedb526d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:33.346 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:33.351+0000 7f2bf046d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:33.351 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:33.358+0000 7f2bf046d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:33.894 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:33.895 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:40:34.013 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:34.014+0000 7fd0ff79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:34.018 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:34.024+0000 7fd0ff79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:34.147 INFO:teuthology.orchestra.run.smithi165.stderr:enabled application 'rados' on pool 'unique_pool_7' 2024-04-25T09:40:34.377 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:40:34.394 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:40:34.544 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:34.544+0000 7f3f834ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:34.548 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:34.556+0000 7f3f834ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:35.169 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_7 bench 90 write' 2024-04-25T09:40:35.172 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-04-25T09:40:35.172 INFO:teuthology.orchestra.run:waiting for 3000 2024-04-25T09:40:35.233 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-04-25T09:40:35.233 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-04-25T09:40:35.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_61277 2024-04-25T09:40:35.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:40:35.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-04-25T09:40:35.382 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:40:35.403 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:40:35.514 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:35.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:35.567+0000 7f4cbe42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:35.573 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:35.580+0000 7f4cbe42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:35.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:35.661+0000 7fed8a59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:35.661 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:35.668+0000 7fed8a59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:36.233 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 144 128 0.999944 1 0.148157 0.118026 2024-04-25T09:40:36.382 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:40:36.399 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:40:36.537 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:36.534+0000 7f4c0ef9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:36.542 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:36.549+0000 7f4c0ef9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:37.233 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 293 277 1.08196 1.16406 0.0362879 0.109025 2024-04-25T09:40:37.392 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:40:37.407 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:40:37.407 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:37.528 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:37.531+0000 7f0e7e91d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:37.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:37.539+0000 7f0e7e91d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:37.742 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:37.743 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:37.757 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-04-25T09:40:37.400373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573408,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":257,"num_write_kb":2854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":460596,"kb_used_data":3476,"kb_used_omap":0,"kb_used_meta":457088,"kb_avail":377026764,"statfs":{"total":386547056640,"available":386075406336,"internally_reserved":0,"allocated":3559424,"data_stored":4296387,"data_compressed":167416,"data_compressed_allocated":876544,"data_compressed_original":3227648,"omap_allocated":0,"internal_metadata":468058112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.242000"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.434427+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:35.434427+0000","last_peered":"2024-04-25T09:40:35.434427+0000","last_clean":"2024-04-25T09:40:35.434427+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:35.434427+0000","last_undegraded":"2024-04-25T09:40:35.434427+0000","last_fullsized":"2024-04-25T09:40:35.434427+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.289208+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:36.289208+0000","last_peered":"2024-04-25T09:40:36.289208+0000","last_clean":"2024-04-25T09:40:36.289208+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:36.289208+0000","last_undegraded":"2024-04-25T09:40:36.289208+0000","last_fullsized":"2024-04-25T09:40:36.289208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.260303+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:36.260303+0000","last_peered":"2024-04-25T09:40:36.260303+0000","last_clean":"2024-04-25T09:40:36.260303+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:36.260303+0000","last_undegraded":"2024-04-25T09:40:36.260303+0000","last_fullsized":"2024-04-25T09:40:36.260303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"104'31","reported_seq":47,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.494099+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:36.494099+0000","last_peered":"2024-04-25T09:40:36.494099+0000","last_clean":"2024-04-25T09:40:36.494099+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:36.494099+0000","last_undegraded":"2024-04-25T09:40:36.494099+0000","last_fullsized":"2024-04-25T09:40:36.494099+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.444571+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:36.444571+0000","last_peered":"2024-04-25T09:40:36.444571+0000","last_clean":"2024-04-25T09:40:36.444571+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:36.444571+0000","last_undegraded":"2024-04-25T09:40:36.444571+0000","last_fullsized":"2024-04-25T09:40:36.444571+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"103'7","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.682902+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:35.682902+0000","last_peered":"2024-04-25T09:40:35.682902+0000","last_clean":"2024-04-25T09:40:35.682902+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:35.682902+0000","last_undegraded":"2024-04-25T09:40:35.682902+0000","last_fullsized":"2024-04-25T09:40:35.682902+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":361,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.577895+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:22.577895+0000","last_peered":"2024-04-25T09:40:22.577895+0000","last_clean":"2024-04-25T09:40:22.577895+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:22.577895+0000","last_undegraded":"2024-04-25T09:40:22.577895+0000","last_fullsized":"2024-04-25T09:40:22.577895+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.506608+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:34.506608+0000","last_peered":"2024-04-25T09:40:34.506608+0000","last_clean":"2024-04-25T09:40:34.506608+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:34.506608+0000","last_undegraded":"2024-04-25T09:40:34.506608+0000","last_fullsized":"2024-04-25T09:40:34.506608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.444359+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:35.444359+0000","last_peered":"2024-04-25T09:40:35.444359+0000","last_clean":"2024-04-25T09:40:35.444359+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:35.444359+0000","last_undegraded":"2024-04-25T09:40:35.444359+0000","last_fullsized":"2024-04-25T09:40:35.444359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.480633+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:34.480633+0000","last_peered":"2024-04-25T09:40:34.480633+0000","last_clean":"2024-04-25T09:40:34.480633+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:34.480633+0000","last_undegraded":"2024-04-25T09:40:34.480633+0000","last_fullsized":"2024-04-25T09:40:34.480633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.094638+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:36.094638+0000","last_peered":"2024-04-25T09:40:36.094638+0000","last_clean":"2024-04-25T09:40:36.094638+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:36.094638+0000","last_undegraded":"2024-04-25T09:40:36.094638+0000","last_fullsized":"2024-04-25T09:40:36.094638+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.456109+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:35.456109+0000","last_peered":"2024-04-25T09:40:35.456109+0000","last_clean":"2024-04-25T09:40:35.456109+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:35.456109+0000","last_undegraded":"2024-04-25T09:40:35.456109+0000","last_fullsized":"2024-04-25T09:40:35.456109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.439743+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:35.439743+0000","last_peered":"2024-04-25T09:40:35.439743+0000","last_clean":"2024-04-25T09:40:35.439743+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:35.439743+0000","last_undegraded":"2024-04-25T09:40:35.439743+0000","last_fullsized":"2024-04-25T09:40:35.439743+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.581077+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:22.581077+0000","last_peered":"2024-04-25T09:40:22.581077+0000","last_clean":"2024-04-25T09:40:22.581077+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:22.581077+0000","last_undegraded":"2024-04-25T09:40:22.581077+0000","last_fullsized":"2024-04-25T09:40:22.581077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.602712+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:35.602712+0000","last_peered":"2024-04-25T09:40:35.602712+0000","last_clean":"2024-04-25T09:40:35.602712+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:35.602712+0000","last_undegraded":"2024-04-25T09:40:35.602712+0000","last_fullsized":"2024-04-25T09:40:35.602712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.611009+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:22.611009+0000","last_peered":"2024-04-25T09:40:22.611009+0000","last_clean":"2024-04-25T09:40:22.611009+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:22.611009+0000","last_undegraded":"2024-04-25T09:40:22.611009+0000","last_fullsized":"2024-04-25T09:40:22.611009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.414574+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:36.414574+0000","last_peered":"2024-04-25T09:40:36.414574+0000","last_clean":"2024-04-25T09:40:36.414574+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:36.414574+0000","last_undegraded":"2024-04-25T09:40:36.414574+0000","last_fullsized":"2024-04-25T09:40:36.414574+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.572635+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:22.572635+0000","last_peered":"2024-04-25T09:40:22.572635+0000","last_clean":"2024-04-25T09:40:22.572635+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:22.572635+0000","last_undegraded":"2024-04-25T09:40:22.572635+0000","last_fullsized":"2024-04-25T09:40:22.572635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.490336+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:34.490336+0000","last_peered":"2024-04-25T09:40:34.490336+0000","last_clean":"2024-04-25T09:40:34.490336+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:34.490336+0000","last_undegraded":"2024-04-25T09:40:34.490336+0000","last_fullsized":"2024-04-25T09:40:34.490336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.489964+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:34.489964+0000","last_peered":"2024-04-25T09:40:34.489964+0000","last_clean":"2024-04-25T09:40:34.489964+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:34.489964+0000","last_undegraded":"2024-04-25T09:40:34.489964+0000","last_fullsized":"2024-04-25T09:40:34.489964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1212416,"data_stored":2424832,"data_compressed":124734,"data_compressed_allocated":1212416,"data_compressed_original":2424832,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":33,"acting":33,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117744,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254096,"statfs":{"total":96636764160,"available":96516194304,"internally_reserved":0,"allocated":696320,"data_stored":837129,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673729,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103856,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267984,"statfs":{"total":96636764160,"available":96530415616,"internally_reserved":0,"allocated":696320,"data_stored":837129,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104412,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267428,"statfs":{"total":96636764160,"available":96529846272,"internally_reserved":0,"allocated":1265664,"data_stored":1448264,"data_compressed":61106,"data_compressed_allocated":593920,"data_compressed_original":1187840,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134584,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94237256,"statfs":{"total":96636764160,"available":96498950144,"internally_reserved":0,"allocated":901120,"data_stored":1173865,"data_compressed":46376,"data_compressed_allocated":200704,"data_compressed_original":892928,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":1228800,"data_compressed":63206,"data_compressed_allocated":614400,"data_compressed_original":1228800,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":1196032,"data_compressed":61528,"data_compressed_allocated":598016,"data_compressed_original":1196032,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:37.759 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:37.810 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:37.886 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:37.887+0000 7f797b66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:37.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:37.897+0000 7f797b66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:37.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:37.951+0000 7fb5c0b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:37.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:37.958+0000 7fb5c0b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:38.143 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:38.144 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:38.158 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-04-25T09:40:37.400373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573408,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":257,"num_write_kb":2854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":460596,"kb_used_data":3476,"kb_used_omap":0,"kb_used_meta":457088,"kb_avail":377026764,"statfs":{"total":386547056640,"available":386075406336,"internally_reserved":0,"allocated":3559424,"data_stored":4296387,"data_compressed":167416,"data_compressed_allocated":876544,"data_compressed_original":3227648,"omap_allocated":0,"internal_metadata":468058112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.242000"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.434427+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:35.434427+0000","last_peered":"2024-04-25T09:40:35.434427+0000","last_clean":"2024-04-25T09:40:35.434427+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:35.434427+0000","last_undegraded":"2024-04-25T09:40:35.434427+0000","last_fullsized":"2024-04-25T09:40:35.434427+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.289208+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:36.289208+0000","last_peered":"2024-04-25T09:40:36.289208+0000","last_clean":"2024-04-25T09:40:36.289208+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:36.289208+0000","last_undegraded":"2024-04-25T09:40:36.289208+0000","last_fullsized":"2024-04-25T09:40:36.289208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.260303+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:36.260303+0000","last_peered":"2024-04-25T09:40:36.260303+0000","last_clean":"2024-04-25T09:40:36.260303+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:36.260303+0000","last_undegraded":"2024-04-25T09:40:36.260303+0000","last_fullsized":"2024-04-25T09:40:36.260303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"104'31","reported_seq":47,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.494099+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:36.494099+0000","last_peered":"2024-04-25T09:40:36.494099+0000","last_clean":"2024-04-25T09:40:36.494099+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:36.494099+0000","last_undegraded":"2024-04-25T09:40:36.494099+0000","last_fullsized":"2024-04-25T09:40:36.494099+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.444571+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:36.444571+0000","last_peered":"2024-04-25T09:40:36.444571+0000","last_clean":"2024-04-25T09:40:36.444571+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:36.444571+0000","last_undegraded":"2024-04-25T09:40:36.444571+0000","last_fullsized":"2024-04-25T09:40:36.444571+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"103'7","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.682902+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:35.682902+0000","last_peered":"2024-04-25T09:40:35.682902+0000","last_clean":"2024-04-25T09:40:35.682902+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:35.682902+0000","last_undegraded":"2024-04-25T09:40:35.682902+0000","last_fullsized":"2024-04-25T09:40:35.682902+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":361,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.577895+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:22.577895+0000","last_peered":"2024-04-25T09:40:22.577895+0000","last_clean":"2024-04-25T09:40:22.577895+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:22.577895+0000","last_undegraded":"2024-04-25T09:40:22.577895+0000","last_fullsized":"2024-04-25T09:40:22.577895+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.506608+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:34.506608+0000","last_peered":"2024-04-25T09:40:34.506608+0000","last_clean":"2024-04-25T09:40:34.506608+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:34.506608+0000","last_undegraded":"2024-04-25T09:40:34.506608+0000","last_fullsized":"2024-04-25T09:40:34.506608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.444359+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:35.444359+0000","last_peered":"2024-04-25T09:40:35.444359+0000","last_clean":"2024-04-25T09:40:35.444359+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:35.444359+0000","last_undegraded":"2024-04-25T09:40:35.444359+0000","last_fullsized":"2024-04-25T09:40:35.444359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.480633+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:34.480633+0000","last_peered":"2024-04-25T09:40:34.480633+0000","last_clean":"2024-04-25T09:40:34.480633+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:34.480633+0000","last_undegraded":"2024-04-25T09:40:34.480633+0000","last_fullsized":"2024-04-25T09:40:34.480633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.094638+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:36.094638+0000","last_peered":"2024-04-25T09:40:36.094638+0000","last_clean":"2024-04-25T09:40:36.094638+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:36.094638+0000","last_undegraded":"2024-04-25T09:40:36.094638+0000","last_fullsized":"2024-04-25T09:40:36.094638+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.456109+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:35.456109+0000","last_peered":"2024-04-25T09:40:35.456109+0000","last_clean":"2024-04-25T09:40:35.456109+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:35.456109+0000","last_undegraded":"2024-04-25T09:40:35.456109+0000","last_fullsized":"2024-04-25T09:40:35.456109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.439743+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:35.439743+0000","last_peered":"2024-04-25T09:40:35.439743+0000","last_clean":"2024-04-25T09:40:35.439743+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:35.439743+0000","last_undegraded":"2024-04-25T09:40:35.439743+0000","last_fullsized":"2024-04-25T09:40:35.439743+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.581077+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:22.581077+0000","last_peered":"2024-04-25T09:40:22.581077+0000","last_clean":"2024-04-25T09:40:22.581077+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:22.581077+0000","last_undegraded":"2024-04-25T09:40:22.581077+0000","last_fullsized":"2024-04-25T09:40:22.581077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.602712+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:35.602712+0000","last_peered":"2024-04-25T09:40:35.602712+0000","last_clean":"2024-04-25T09:40:35.602712+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:35.602712+0000","last_undegraded":"2024-04-25T09:40:35.602712+0000","last_fullsized":"2024-04-25T09:40:35.602712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.611009+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:22.611009+0000","last_peered":"2024-04-25T09:40:22.611009+0000","last_clean":"2024-04-25T09:40:22.611009+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:22.611009+0000","last_undegraded":"2024-04-25T09:40:22.611009+0000","last_fullsized":"2024-04-25T09:40:22.611009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.414574+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:36.414574+0000","last_peered":"2024-04-25T09:40:36.414574+0000","last_clean":"2024-04-25T09:40:36.414574+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:36.414574+0000","last_undegraded":"2024-04-25T09:40:36.414574+0000","last_fullsized":"2024-04-25T09:40:36.414574+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.572635+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:22.572635+0000","last_peered":"2024-04-25T09:40:22.572635+0000","last_clean":"2024-04-25T09:40:22.572635+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:22.572635+0000","last_undegraded":"2024-04-25T09:40:22.572635+0000","last_fullsized":"2024-04-25T09:40:22.572635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.490336+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:34.490336+0000","last_peered":"2024-04-25T09:40:34.490336+0000","last_clean":"2024-04-25T09:40:34.490336+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:34.490336+0000","last_undegraded":"2024-04-25T09:40:34.490336+0000","last_fullsized":"2024-04-25T09:40:34.490336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.489964+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:34.489964+0000","last_peered":"2024-04-25T09:40:34.489964+0000","last_clean":"2024-04-25T09:40:34.489964+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:34.489964+0000","last_undegraded":"2024-04-25T09:40:34.489964+0000","last_fullsized":"2024-04-25T09:40:34.489964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1212416,"data_stored":2424832,"data_compressed":124734,"data_compressed_allocated":1212416,"data_compressed_original":2424832,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":33,"acting":33,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117744,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254096,"statfs":{"total":96636764160,"available":96516194304,"internally_reserved":0,"allocated":696320,"data_stored":837129,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673729,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103856,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267984,"statfs":{"total":96636764160,"available":96530415616,"internally_reserved":0,"allocated":696320,"data_stored":837129,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104412,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267428,"statfs":{"total":96636764160,"available":96529846272,"internally_reserved":0,"allocated":1265664,"data_stored":1448264,"data_compressed":61106,"data_compressed_allocated":593920,"data_compressed_original":1187840,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134584,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94237256,"statfs":{"total":96636764160,"available":96498950144,"internally_reserved":0,"allocated":901120,"data_stored":1173865,"data_compressed":46376,"data_compressed_allocated":200704,"data_compressed_original":892928,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":1228800,"data_compressed":63206,"data_compressed_allocated":614400,"data_compressed_original":1228800,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":1196032,"data_compressed":61528,"data_compressed_allocated":598016,"data_compressed_original":1196032,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:38.160 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:40:38.233 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 425 409 1.06502 1.03125 0.169878 0.114737 2024-04-25T09:40:38.281 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:38.284+0000 7f7a4dced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:38.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:38.293+0000 7f7a4dced640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:38.565 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:38.565 INFO:teuthology.orchestra.run.smithi165.stdout:{"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":784,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":106,"num_osds":4,"num_up_osds":4,"osd_up_since":1714037262,"num_in_osds":4,"osd_in_since":1714037256,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":20},{"state_name":"unknown","count":5}],"num_pgs":25,"num_pools":3,"num_objects":17,"data_bytes":1573408,"bytes_used":471650304,"bytes_avail":386075406336,"bytes_total":386547056640,"unknown_pgs_ratio":0.20000000298023224,"write_bytes_sec":245720,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-04-25T09:28:41.235287+0000","services":{}},"progress_events":{}} 2024-04-25T09:40:38.580 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-25T09:40:38.580 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:38.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:38.747+0000 7f88e6554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:38.751 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:38.758+0000 7f88e6554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:38.974 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:38.974 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:38.989 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-04-25T09:40:37.400373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1573408,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":257,"num_write_kb":2854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":60,"acting":60,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":460596,"kb_used_data":3476,"kb_used_omap":0,"kb_used_meta":457088,"kb_avail":377026764,"statfs":{"total":386547056640,"available":386075406336,"internally_reserved":0,"allocated":3559424,"data_stored":4296387,"data_compressed":167416,"data_compressed_allocated":876544,"data_compressed_original":3227648,"omap_allocated":0,"internal_metadata":468058112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.242000"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.434427+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:35.434427+0000","last_peered":"2024-04-25T09:40:35.434427+0000","last_clean":"2024-04-25T09:40:35.434427+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:35.434427+0000","last_undegraded":"2024-04-25T09:40:35.434427+0000","last_fullsized":"2024-04-25T09:40:35.434427+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.289208+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:36.289208+0000","last_peered":"2024-04-25T09:40:36.289208+0000","last_clean":"2024-04-25T09:40:36.289208+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:36.289208+0000","last_undegraded":"2024-04-25T09:40:36.289208+0000","last_fullsized":"2024-04-25T09:40:36.289208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.260303+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:36.260303+0000","last_peered":"2024-04-25T09:40:36.260303+0000","last_clean":"2024-04-25T09:40:36.260303+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:36.260303+0000","last_undegraded":"2024-04-25T09:40:36.260303+0000","last_fullsized":"2024-04-25T09:40:36.260303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"104'31","reported_seq":47,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.494099+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:36.494099+0000","last_peered":"2024-04-25T09:40:36.494099+0000","last_clean":"2024-04-25T09:40:36.494099+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:36.494099+0000","last_undegraded":"2024-04-25T09:40:36.494099+0000","last_fullsized":"2024-04-25T09:40:36.494099+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.444571+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:36.444571+0000","last_peered":"2024-04-25T09:40:36.444571+0000","last_clean":"2024-04-25T09:40:36.444571+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:36.444571+0000","last_undegraded":"2024-04-25T09:40:36.444571+0000","last_fullsized":"2024-04-25T09:40:36.444571+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"103'7","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.682902+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:35.682902+0000","last_peered":"2024-04-25T09:40:35.682902+0000","last_clean":"2024-04-25T09:40:35.682902+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:35.682902+0000","last_undegraded":"2024-04-25T09:40:35.682902+0000","last_fullsized":"2024-04-25T09:40:35.682902+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":361,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.577895+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:22.577895+0000","last_peered":"2024-04-25T09:40:22.577895+0000","last_clean":"2024-04-25T09:40:22.577895+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:22.577895+0000","last_undegraded":"2024-04-25T09:40:22.577895+0000","last_fullsized":"2024-04-25T09:40:22.577895+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.506608+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:34.506608+0000","last_peered":"2024-04-25T09:40:34.506608+0000","last_clean":"2024-04-25T09:40:34.506608+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:34.506608+0000","last_undegraded":"2024-04-25T09:40:34.506608+0000","last_fullsized":"2024-04-25T09:40:34.506608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.444359+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:35.444359+0000","last_peered":"2024-04-25T09:40:35.444359+0000","last_clean":"2024-04-25T09:40:35.444359+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:35.444359+0000","last_undegraded":"2024-04-25T09:40:35.444359+0000","last_fullsized":"2024-04-25T09:40:35.444359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:40:33.148925+0000","last_change":"2024-04-25T09:40:33.148925+0000","last_active":"2024-04-25T09:40:33.148925+0000","last_peered":"2024-04-25T09:40:33.148925+0000","last_clean":"2024-04-25T09:40:33.148925+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:40:33.148925+0000","last_undegraded":"2024-04-25T09:40:33.148925+0000","last_fullsized":"2024-04-25T09:40:33.148925+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.480633+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:34.480633+0000","last_peered":"2024-04-25T09:40:34.480633+0000","last_clean":"2024-04-25T09:40:34.480633+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:34.480633+0000","last_undegraded":"2024-04-25T09:40:34.480633+0000","last_fullsized":"2024-04-25T09:40:34.480633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.094638+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:36.094638+0000","last_peered":"2024-04-25T09:40:36.094638+0000","last_clean":"2024-04-25T09:40:36.094638+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:36.094638+0000","last_undegraded":"2024-04-25T09:40:36.094638+0000","last_fullsized":"2024-04-25T09:40:36.094638+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.456109+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:35.456109+0000","last_peered":"2024-04-25T09:40:35.456109+0000","last_clean":"2024-04-25T09:40:35.456109+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:35.456109+0000","last_undegraded":"2024-04-25T09:40:35.456109+0000","last_fullsized":"2024-04-25T09:40:35.456109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.439743+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:35.439743+0000","last_peered":"2024-04-25T09:40:35.439743+0000","last_clean":"2024-04-25T09:40:35.439743+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:35.439743+0000","last_undegraded":"2024-04-25T09:40:35.439743+0000","last_fullsized":"2024-04-25T09:40:35.439743+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.581077+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:22.581077+0000","last_peered":"2024-04-25T09:40:22.581077+0000","last_clean":"2024-04-25T09:40:22.581077+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:22.581077+0000","last_undegraded":"2024-04-25T09:40:22.581077+0000","last_fullsized":"2024-04-25T09:40:22.581077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.602712+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:35.602712+0000","last_peered":"2024-04-25T09:40:35.602712+0000","last_clean":"2024-04-25T09:40:35.602712+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:35.602712+0000","last_undegraded":"2024-04-25T09:40:35.602712+0000","last_fullsized":"2024-04-25T09:40:35.602712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.611009+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:22.611009+0000","last_peered":"2024-04-25T09:40:22.611009+0000","last_clean":"2024-04-25T09:40:22.611009+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:22.611009+0000","last_undegraded":"2024-04-25T09:40:22.611009+0000","last_fullsized":"2024-04-25T09:40:22.611009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.414574+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:36.414574+0000","last_peered":"2024-04-25T09:40:36.414574+0000","last_clean":"2024-04-25T09:40:36.414574+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:36.414574+0000","last_undegraded":"2024-04-25T09:40:36.414574+0000","last_fullsized":"2024-04-25T09:40:36.414574+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-25T09:40:22.572635+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:22.572635+0000","last_peered":"2024-04-25T09:40:22.572635+0000","last_clean":"2024-04-25T09:40:22.572635+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:22.572635+0000","last_undegraded":"2024-04-25T09:40:22.572635+0000","last_fullsized":"2024-04-25T09:40:22.572635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.490336+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:34.490336+0000","last_peered":"2024-04-25T09:40:34.490336+0000","last_clean":"2024-04-25T09:40:34.490336+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:34.490336+0000","last_undegraded":"2024-04-25T09:40:34.490336+0000","last_fullsized":"2024-04-25T09:40:34.490336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.489964+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:34.489964+0000","last_peered":"2024-04-25T09:40:34.489964+0000","last_clean":"2024-04-25T09:40:34.489964+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:34.489964+0000","last_undegraded":"2024-04-25T09:40:34.489964+0000","last_fullsized":"2024-04-25T09:40:34.489964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1212416,"data_stored":2424832,"data_compressed":124734,"data_compressed_allocated":1212416,"data_compressed_original":2424832,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":33,"acting":33,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673728,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117744,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254096,"statfs":{"total":96636764160,"available":96516194304,"internally_reserved":0,"allocated":696320,"data_stored":837129,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673729,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103856,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267984,"statfs":{"total":96636764160,"available":96530415616,"internally_reserved":0,"allocated":696320,"data_stored":837129,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104412,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267428,"statfs":{"total":96636764160,"available":96529846272,"internally_reserved":0,"allocated":1265664,"data_stored":1448264,"data_compressed":61106,"data_compressed_allocated":593920,"data_compressed_original":1187840,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134584,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94237256,"statfs":{"total":96636764160,"available":96498950144,"internally_reserved":0,"allocated":901120,"data_stored":1173865,"data_compressed":46376,"data_compressed_allocated":200704,"data_compressed_original":892928,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":1228800,"data_compressed":63206,"data_compressed_allocated":614400,"data_compressed_original":1228800,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":1196032,"data_compressed":61528,"data_compressed_allocated":598016,"data_compressed_original":1196032,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:39.233 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 549 533 1.04093 0.96875 0.026397 0.117405 2024-04-25T09:40:40.180 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:40.233 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 682 666 1.04055 1.03906 0.0972535 0.117424 2024-04-25T09:40:40.297 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:40.302+0000 7fe17f46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:40.302 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:40.309+0000 7fe17f46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:41.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 819 803 1.04549 1.07031 0.165441 0.118518 2024-04-25T09:40:41.992 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:42.110 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:42.113+0000 7fe43b20f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:42.115 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:42.122+0000 7fe43b20f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:42.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 965 949 1.05907 1.14062 0.0238393 0.116953 2024-04-25T09:40:42.353 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:42.354 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:42.375 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2024-04-25T09:40:41.392841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2441760,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":363,"num_write_kb":3702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":466276,"kb_used_data":4996,"kb_used_omap":0,"kb_used_meta":461248,"kb_avail":377021084,"statfs":{"total":386547056640,"available":386069590016,"internally_reserved":0,"allocated":5115904,"data_stored":7250480,"data_compressed":317496,"data_compressed_allocated":2334720,"data_compressed_original":6144000,"omap_allocated":0,"internal_metadata":472317952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1851392,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":1808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001176"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.434427+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:35.434427+0000","last_peered":"2024-04-25T09:40:35.434427+0000","last_clean":"2024-04-25T09:40:35.434427+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:35.434427+0000","last_undegraded":"2024-04-25T09:40:35.434427+0000","last_fullsized":"2024-04-25T09:40:35.434427+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.289208+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:36.289208+0000","last_peered":"2024-04-25T09:40:36.289208+0000","last_clean":"2024-04-25T09:40:36.289208+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:36.289208+0000","last_undegraded":"2024-04-25T09:40:36.289208+0000","last_fullsized":"2024-04-25T09:40:36.289208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"105'16","reported_seq":37,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.421818+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:40:37.421818+0000","last_peered":"2024-04-25T09:40:37.421818+0000","last_clean":"2024-04-25T09:40:37.421818+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:40:37.421818+0000","last_undegraded":"2024-04-25T09:40:37.421818+0000","last_fullsized":"2024-04-25T09:40:37.421818+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"104'34","reported_seq":50,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.493864+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:40:37.493864+0000","last_peered":"2024-04-25T09:40:37.493864+0000","last_clean":"2024-04-25T09:40:37.493864+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:40:37.493864+0000","last_undegraded":"2024-04-25T09:40:37.493864+0000","last_fullsized":"2024-04-25T09:40:37.493864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286720,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.260303+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:36.260303+0000","last_peered":"2024-04-25T09:40:36.260303+0000","last_clean":"2024-04-25T09:40:36.260303+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:36.260303+0000","last_undegraded":"2024-04-25T09:40:36.260303+0000","last_fullsized":"2024-04-25T09:40:36.260303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.144566+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:40:36.144566+0000","last_peered":"2024-04-25T09:40:36.144566+0000","last_clean":"2024-04-25T09:40:36.144566+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:40:36.144566+0000","last_undegraded":"2024-04-25T09:40:36.144566+0000","last_fullsized":"2024-04-25T09:40:36.144566+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"104'31","reported_seq":47,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.494099+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:36.494099+0000","last_peered":"2024-04-25T09:40:36.494099+0000","last_clean":"2024-04-25T09:40:36.494099+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:36.494099+0000","last_undegraded":"2024-04-25T09:40:36.494099+0000","last_fullsized":"2024-04-25T09:40:36.494099+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.444571+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:36.444571+0000","last_peered":"2024-04-25T09:40:36.444571+0000","last_clean":"2024-04-25T09:40:36.444571+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:36.444571+0000","last_undegraded":"2024-04-25T09:40:36.444571+0000","last_fullsized":"2024-04-25T09:40:36.444571+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"103'7","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.682902+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:35.682902+0000","last_peered":"2024-04-25T09:40:35.682902+0000","last_clean":"2024-04-25T09:40:35.682902+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:35.682902+0000","last_undegraded":"2024-04-25T09:40:35.682902+0000","last_fullsized":"2024-04-25T09:40:35.682902+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":376,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.500017+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:35.500017+0000","last_peered":"2024-04-25T09:40:35.500017+0000","last_clean":"2024-04-25T09:40:35.500017+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:35.500017+0000","last_undegraded":"2024-04-25T09:40:35.500017+0000","last_fullsized":"2024-04-25T09:40:35.500017+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.506608+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:34.506608+0000","last_peered":"2024-04-25T09:40:34.506608+0000","last_clean":"2024-04-25T09:40:34.506608+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:34.506608+0000","last_undegraded":"2024-04-25T09:40:34.506608+0000","last_fullsized":"2024-04-25T09:40:34.506608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"105'32","reported_seq":53,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.447808+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:40:37.447808+0000","last_peered":"2024-04-25T09:40:37.447808+0000","last_clean":"2024-04-25T09:40:37.447808+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:40:37.447808+0000","last_undegraded":"2024-04-25T09:40:37.447808+0000","last_fullsized":"2024-04-25T09:40:37.447808+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.444359+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:35.444359+0000","last_peered":"2024-04-25T09:40:35.444359+0000","last_clean":"2024-04-25T09:40:35.444359+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:35.444359+0000","last_undegraded":"2024-04-25T09:40:35.444359+0000","last_fullsized":"2024-04-25T09:40:35.444359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"104'6","reported_seq":22,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.486925+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:40:37.486925+0000","last_peered":"2024-04-25T09:40:37.486925+0000","last_clean":"2024-04-25T09:40:37.486925+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:40:37.486925+0000","last_undegraded":"2024-04-25T09:40:37.486925+0000","last_fullsized":"2024-04-25T09:40:37.486925+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.480633+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:34.480633+0000","last_peered":"2024-04-25T09:40:34.480633+0000","last_clean":"2024-04-25T09:40:34.480633+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:34.480633+0000","last_undegraded":"2024-04-25T09:40:34.480633+0000","last_fullsized":"2024-04-25T09:40:34.480633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.094638+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:36.094638+0000","last_peered":"2024-04-25T09:40:36.094638+0000","last_clean":"2024-04-25T09:40:36.094638+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:36.094638+0000","last_undegraded":"2024-04-25T09:40:36.094638+0000","last_fullsized":"2024-04-25T09:40:36.094638+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.456109+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:35.456109+0000","last_peered":"2024-04-25T09:40:35.456109+0000","last_clean":"2024-04-25T09:40:35.456109+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:35.456109+0000","last_undegraded":"2024-04-25T09:40:35.456109+0000","last_fullsized":"2024-04-25T09:40:35.456109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.439743+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:35.439743+0000","last_peered":"2024-04-25T09:40:35.439743+0000","last_clean":"2024-04-25T09:40:35.439743+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:35.439743+0000","last_undegraded":"2024-04-25T09:40:35.439743+0000","last_fullsized":"2024-04-25T09:40:35.439743+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.435782+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:37.435782+0000","last_peered":"2024-04-25T09:40:37.435782+0000","last_clean":"2024-04-25T09:40:37.435782+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:37.435782+0000","last_undegraded":"2024-04-25T09:40:37.435782+0000","last_fullsized":"2024-04-25T09:40:37.435782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.602712+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:35.602712+0000","last_peered":"2024-04-25T09:40:35.602712+0000","last_clean":"2024-04-25T09:40:35.602712+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:35.602712+0000","last_undegraded":"2024-04-25T09:40:35.602712+0000","last_fullsized":"2024-04-25T09:40:35.602712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":243,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.543948+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:35.543948+0000","last_peered":"2024-04-25T09:40:35.543948+0000","last_clean":"2024-04-25T09:40:35.543948+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:35.543948+0000","last_undegraded":"2024-04-25T09:40:35.543948+0000","last_fullsized":"2024-04-25T09:40:35.543948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.414574+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:36.414574+0000","last_peered":"2024-04-25T09:40:36.414574+0000","last_clean":"2024-04-25T09:40:36.414574+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:36.414574+0000","last_undegraded":"2024-04-25T09:40:36.414574+0000","last_fullsized":"2024-04-25T09:40:36.414574+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.453398+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:37.453398+0000","last_peered":"2024-04-25T09:40:37.453398+0000","last_clean":"2024-04-25T09:40:37.453398+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:37.453398+0000","last_undegraded":"2024-04-25T09:40:37.453398+0000","last_fullsized":"2024-04-25T09:40:37.453398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.490336+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:34.490336+0000","last_peered":"2024-04-25T09:40:34.490336+0000","last_clean":"2024-04-25T09:40:34.490336+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:34.490336+0000","last_undegraded":"2024-04-25T09:40:34.490336+0000","last_fullsized":"2024-04-25T09:40:34.490336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.489964+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:34.489964+0000","last_peered":"2024-04-25T09:40:34.489964+0000","last_clean":"2024-04-25T09:40:34.489964+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:34.489964+0000","last_undegraded":"2024-04-25T09:40:34.489964+0000","last_fullsized":"2024-04-25T09:40:34.489964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":1851392,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":1808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3002368,"data_stored":6004736,"data_compressed":308996,"data_compressed_allocated":3002368,"data_compressed_original":6004736,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122268,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94249572,"statfs":{"total":96636764160,"available":96511561728,"internally_reserved":0,"allocated":1069056,"data_stored":1509737,"data_compressed":63677,"data_compressed_allocated":368640,"data_compressed_original":1228800,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105012,"kb_used_data":1836,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94266828,"statfs":{"total":96636764160,"available":96529231872,"internally_reserved":0,"allocated":1880064,"data_stored":3118614,"data_compressed":146337,"data_compressed_allocated":1171456,"data_compressed_original":2834432,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104412,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267428,"statfs":{"total":96636764160,"available":96529846272,"internally_reserved":0,"allocated":1265664,"data_stored":1448264,"data_compressed":61106,"data_compressed_allocated":593920,"data_compressed_original":1187840,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134584,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94237256,"statfs":{"total":96636764160,"available":96498950144,"internally_reserved":0,"allocated":901120,"data_stored":1173865,"data_compressed":46376,"data_compressed_allocated":200704,"data_compressed_original":892928,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":1228800,"data_compressed":63206,"data_compressed_allocated":614400,"data_compressed_original":1228800,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":1196032,"data_compressed":61528,"data_compressed_allocated":598016,"data_compressed_original":1196032,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1204224,"data_stored":2408448,"data_compressed":123966,"data_compressed_allocated":1204224,"data_compressed_original":2408448,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":1171456,"data_compressed":60296,"data_compressed_allocated":585728,"data_compressed_original":1171456,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:42.376 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:40:42.376 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:42.377 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:42.486 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:42.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:42.498+0000 7f7ab646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:42.500 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:42.507+0000 7f7ab646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:42.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:42.611+0000 7f85ca39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:42.612 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:42.619+0000 7f85ca39d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:42.777 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:42.778 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:42.795 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2024-04-25T09:40:41.392841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2441760,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":363,"num_write_kb":3702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":466276,"kb_used_data":4996,"kb_used_omap":0,"kb_used_meta":461248,"kb_avail":377021084,"statfs":{"total":386547056640,"available":386069590016,"internally_reserved":0,"allocated":5115904,"data_stored":7250480,"data_compressed":317496,"data_compressed_allocated":2334720,"data_compressed_original":6144000,"omap_allocated":0,"internal_metadata":472317952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1851392,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":1808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001176"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.434427+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:35.434427+0000","last_peered":"2024-04-25T09:40:35.434427+0000","last_clean":"2024-04-25T09:40:35.434427+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:35.434427+0000","last_undegraded":"2024-04-25T09:40:35.434427+0000","last_fullsized":"2024-04-25T09:40:35.434427+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.289208+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:36.289208+0000","last_peered":"2024-04-25T09:40:36.289208+0000","last_clean":"2024-04-25T09:40:36.289208+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:36.289208+0000","last_undegraded":"2024-04-25T09:40:36.289208+0000","last_fullsized":"2024-04-25T09:40:36.289208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"105'16","reported_seq":37,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.421818+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:40:37.421818+0000","last_peered":"2024-04-25T09:40:37.421818+0000","last_clean":"2024-04-25T09:40:37.421818+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:40:37.421818+0000","last_undegraded":"2024-04-25T09:40:37.421818+0000","last_fullsized":"2024-04-25T09:40:37.421818+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"104'34","reported_seq":50,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.493864+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:40:37.493864+0000","last_peered":"2024-04-25T09:40:37.493864+0000","last_clean":"2024-04-25T09:40:37.493864+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:40:37.493864+0000","last_undegraded":"2024-04-25T09:40:37.493864+0000","last_fullsized":"2024-04-25T09:40:37.493864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286720,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.260303+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:36.260303+0000","last_peered":"2024-04-25T09:40:36.260303+0000","last_clean":"2024-04-25T09:40:36.260303+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:36.260303+0000","last_undegraded":"2024-04-25T09:40:36.260303+0000","last_fullsized":"2024-04-25T09:40:36.260303+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.144566+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:40:36.144566+0000","last_peered":"2024-04-25T09:40:36.144566+0000","last_clean":"2024-04-25T09:40:36.144566+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:40:36.144566+0000","last_undegraded":"2024-04-25T09:40:36.144566+0000","last_fullsized":"2024-04-25T09:40:36.144566+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"104'31","reported_seq":47,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.494099+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:36.494099+0000","last_peered":"2024-04-25T09:40:36.494099+0000","last_clean":"2024-04-25T09:40:36.494099+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:36.494099+0000","last_undegraded":"2024-04-25T09:40:36.494099+0000","last_fullsized":"2024-04-25T09:40:36.494099+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"103'15","reported_seq":28,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.444571+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:36.444571+0000","last_peered":"2024-04-25T09:40:36.444571+0000","last_clean":"2024-04-25T09:40:36.444571+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:36.444571+0000","last_undegraded":"2024-04-25T09:40:36.444571+0000","last_fullsized":"2024-04-25T09:40:36.444571+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"103'7","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.682902+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:35.682902+0000","last_peered":"2024-04-25T09:40:35.682902+0000","last_clean":"2024-04-25T09:40:35.682902+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:35.682902+0000","last_undegraded":"2024-04-25T09:40:35.682902+0000","last_fullsized":"2024-04-25T09:40:35.682902+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":376,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.500017+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:35.500017+0000","last_peered":"2024-04-25T09:40:35.500017+0000","last_clean":"2024-04-25T09:40:35.500017+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:35.500017+0000","last_undegraded":"2024-04-25T09:40:35.500017+0000","last_fullsized":"2024-04-25T09:40:35.500017+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.506608+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:34.506608+0000","last_peered":"2024-04-25T09:40:34.506608+0000","last_clean":"2024-04-25T09:40:34.506608+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:34.506608+0000","last_undegraded":"2024-04-25T09:40:34.506608+0000","last_fullsized":"2024-04-25T09:40:34.506608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"105'32","reported_seq":53,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.447808+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:40:37.447808+0000","last_peered":"2024-04-25T09:40:37.447808+0000","last_clean":"2024-04-25T09:40:37.447808+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:40:37.447808+0000","last_undegraded":"2024-04-25T09:40:37.447808+0000","last_fullsized":"2024-04-25T09:40:37.447808+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.444359+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:35.444359+0000","last_peered":"2024-04-25T09:40:35.444359+0000","last_clean":"2024-04-25T09:40:35.444359+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:35.444359+0000","last_undegraded":"2024-04-25T09:40:35.444359+0000","last_fullsized":"2024-04-25T09:40:35.444359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"104'6","reported_seq":22,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.486925+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:40:37.486925+0000","last_peered":"2024-04-25T09:40:37.486925+0000","last_clean":"2024-04-25T09:40:37.486925+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:40:37.486925+0000","last_undegraded":"2024-04-25T09:40:37.486925+0000","last_fullsized":"2024-04-25T09:40:37.486925+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57344,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.480633+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:34.480633+0000","last_peered":"2024-04-25T09:40:34.480633+0000","last_clean":"2024-04-25T09:40:34.480633+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:34.480633+0000","last_undegraded":"2024-04-25T09:40:34.480633+0000","last_fullsized":"2024-04-25T09:40:34.480633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.094638+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:36.094638+0000","last_peered":"2024-04-25T09:40:36.094638+0000","last_clean":"2024-04-25T09:40:36.094638+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:36.094638+0000","last_undegraded":"2024-04-25T09:40:36.094638+0000","last_fullsized":"2024-04-25T09:40:36.094638+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":241,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.456109+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:35.456109+0000","last_peered":"2024-04-25T09:40:35.456109+0000","last_clean":"2024-04-25T09:40:35.456109+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:35.456109+0000","last_undegraded":"2024-04-25T09:40:35.456109+0000","last_fullsized":"2024-04-25T09:40:35.456109+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.439743+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:35.439743+0000","last_peered":"2024-04-25T09:40:35.439743+0000","last_clean":"2024-04-25T09:40:35.439743+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:35.439743+0000","last_undegraded":"2024-04-25T09:40:35.439743+0000","last_fullsized":"2024-04-25T09:40:35.439743+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.435782+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:37.435782+0000","last_peered":"2024-04-25T09:40:37.435782+0000","last_clean":"2024-04-25T09:40:37.435782+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:37.435782+0000","last_undegraded":"2024-04-25T09:40:37.435782+0000","last_fullsized":"2024-04-25T09:40:37.435782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"104'7","reported_seq":23,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.602712+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:35.602712+0000","last_peered":"2024-04-25T09:40:35.602712+0000","last_clean":"2024-04-25T09:40:35.602712+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:35.602712+0000","last_undegraded":"2024-04-25T09:40:35.602712+0000","last_fullsized":"2024-04-25T09:40:35.602712+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":243,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:35.543948+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:35.543948+0000","last_peered":"2024-04-25T09:40:35.543948+0000","last_clean":"2024-04-25T09:40:35.543948+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:35.543948+0000","last_undegraded":"2024-04-25T09:40:35.543948+0000","last_fullsized":"2024-04-25T09:40:35.543948+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"104'15","reported_seq":31,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-25T09:40:36.414574+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:36.414574+0000","last_peered":"2024-04-25T09:40:36.414574+0000","last_clean":"2024-04-25T09:40:36.414574+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:36.414574+0000","last_undegraded":"2024-04-25T09:40:36.414574+0000","last_fullsized":"2024-04-25T09:40:36.414574+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:40:37.453398+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:37.453398+0000","last_peered":"2024-04-25T09:40:37.453398+0000","last_clean":"2024-04-25T09:40:37.453398+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:37.453398+0000","last_undegraded":"2024-04-25T09:40:37.453398+0000","last_fullsized":"2024-04-25T09:40:37.453398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.490336+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:34.490336+0000","last_peered":"2024-04-25T09:40:34.490336+0000","last_clean":"2024-04-25T09:40:34.490336+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:34.490336+0000","last_undegraded":"2024-04-25T09:40:34.490336+0000","last_fullsized":"2024-04-25T09:40:34.490336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-25T09:40:34.489964+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:34.489964+0000","last_peered":"2024-04-25T09:40:34.489964+0000","last_clean":"2024-04-25T09:40:34.489964+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:34.489964+0000","last_undegraded":"2024-04-25T09:40:34.489964+0000","last_fullsized":"2024-04-25T09:40:34.489964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":1851392,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":1808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3002368,"data_stored":6004736,"data_compressed":308996,"data_compressed_allocated":3002368,"data_compressed_original":6004736,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122268,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94249572,"statfs":{"total":96636764160,"available":96511561728,"internally_reserved":0,"allocated":1069056,"data_stored":1509737,"data_compressed":63677,"data_compressed_allocated":368640,"data_compressed_original":1228800,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105012,"kb_used_data":1836,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94266828,"statfs":{"total":96636764160,"available":96529231872,"internally_reserved":0,"allocated":1880064,"data_stored":3118614,"data_compressed":146337,"data_compressed_allocated":1171456,"data_compressed_original":2834432,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104412,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267428,"statfs":{"total":96636764160,"available":96529846272,"internally_reserved":0,"allocated":1265664,"data_stored":1448264,"data_compressed":61106,"data_compressed_allocated":593920,"data_compressed_original":1187840,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134584,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94237256,"statfs":{"total":96636764160,"available":96498950144,"internally_reserved":0,"allocated":901120,"data_stored":1173865,"data_compressed":46376,"data_compressed_allocated":200704,"data_compressed_original":892928,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":1228800,"data_compressed":63206,"data_compressed_allocated":614400,"data_compressed_original":1228800,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":1196032,"data_compressed":61528,"data_compressed_allocated":598016,"data_compressed_original":1196032,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1204224,"data_stored":2408448,"data_compressed":123966,"data_compressed_allocated":1204224,"data_compressed_original":2408448,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":1171456,"data_compressed":60296,"data_compressed_allocated":585728,"data_compressed_original":1171456,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:43.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 1095 1079 1.05363 1.01562 0.164817 0.117688 2024-04-25T09:40:44.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 1224 1208 1.04853 1.00781 0.197424 0.118383 2024-04-25T09:40:44.912 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:45.055 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:45.059+0000 7f47f6b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:45.059 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:45.066+0000 7f47f6b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:45.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 1359 1343 1.04914 1.05469 0.0741159 0.118235 2024-04-25T09:40:46.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 1499 1483 1.05318 1.09375 0.183962 0.117812 2024-04-25T09:40:47.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 1647 1631 1.06176 1.15625 0.0886744 0.117056 2024-04-25T09:40:47.274 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:47.397 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:47.402+0000 7f359880f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:47.401 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:47.408+0000 7f359880f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:47.798 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:47.798 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:47.798 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:47.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:47.925+0000 7ff27aead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:47.927 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:47.935+0000 7ff27aead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:48.145 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:48.145 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:48.161 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":493,"stamp":"2024-04-25T09:40:47.394090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11829792,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":1509,"num_write_kb":12870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1453,"ondisk_log_size":1453,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":474052,"kb_used_data":16932,"kb_used_omap":0,"kb_used_meta":457088,"kb_avail":377013308,"statfs":{"total":386547056640,"available":386061627392,"internally_reserved":0,"allocated":17338368,"data_stored":31538048,"data_compressed":1567187,"data_compressed_allocated":14458880,"data_compressed_original":30392320,"omap_allocated":0,"internal_metadata":468058112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10256384,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":10016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.993716"},"pg_stats":[{"pgid":"10.7","version":"107'39","reported_seq":60,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:43.976263+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:43.976263+0000","last_peered":"2024-04-25T09:40:43.976263+0000","last_clean":"2024-04-25T09:40:43.976263+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:43.976263+0000","last_undegraded":"2024-04-25T09:40:43.976263+0000","last_fullsized":"2024-04-25T09:40:43.976263+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"107'119","reported_seq":140,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:46.339396+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:46.339396+0000","last_peered":"2024-04-25T09:40:46.339396+0000","last_clean":"2024-04-25T09:40:46.339396+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:46.339396+0000","last_undegraded":"2024-04-25T09:40:46.339396+0000","last_fullsized":"2024-04-25T09:40:46.339396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"107'63","reported_seq":88,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:42.339803+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:40:42.339803+0000","last_peered":"2024-04-25T09:40:42.339803+0000","last_clean":"2024-04-25T09:40:42.339803+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:40:42.339803+0000","last_undegraded":"2024-04-25T09:40:42.339803+0000","last_fullsized":"2024-04-25T09:40:42.339803+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"107'95","reported_seq":116,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:41.964155+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:40:41.964155+0000","last_peered":"2024-04-25T09:40:41.964155+0000","last_clean":"2024-04-25T09:40:41.964155+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:40:41.964155+0000","last_undegraded":"2024-04-25T09:40:41.964155+0000","last_fullsized":"2024-04-25T09:40:41.964155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"107'79","reported_seq":100,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:43.508932+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:43.508932+0000","last_peered":"2024-04-25T09:40:43.508932+0000","last_clean":"2024-04-25T09:40:43.508932+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:43.508932+0000","last_undegraded":"2024-04-25T09:40:43.508932+0000","last_fullsized":"2024-04-25T09:40:43.508932+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"107'63","reported_seq":84,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:42.440079+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:40:42.440079+0000","last_peered":"2024-04-25T09:40:42.440079+0000","last_clean":"2024-04-25T09:40:42.440079+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:40:42.440079+0000","last_undegraded":"2024-04-25T09:40:42.440079+0000","last_fullsized":"2024-04-25T09:40:42.440079+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"107'103","reported_seq":124,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:45.598574+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:45.598574+0000","last_peered":"2024-04-25T09:40:45.598574+0000","last_clean":"2024-04-25T09:40:45.598574+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:45.598574+0000","last_undegraded":"2024-04-25T09:40:45.598574+0000","last_fullsized":"2024-04-25T09:40:45.598574+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"107'127","reported_seq":148,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:44.809406+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:44.809406+0000","last_peered":"2024-04-25T09:40:44.809406+0000","last_clean":"2024-04-25T09:40:44.809406+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:44.809406+0000","last_undegraded":"2024-04-25T09:40:44.809406+0000","last_fullsized":"2024-04-25T09:40:44.809406+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"107'103","reported_seq":124,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:46.480503+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:46.480503+0000","last_peered":"2024-04-25T09:40:46.480503+0000","last_clean":"2024-04-25T09:40:46.480503+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:46.480503+0000","last_undegraded":"2024-04-25T09:40:46.480503+0000","last_fullsized":"2024-04-25T09:40:46.480503+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":381,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.633865+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:40.633865+0000","last_peered":"2024-04-25T09:40:40.633865+0000","last_clean":"2024-04-25T09:40:40.633865+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:40.633865+0000","last_undegraded":"2024-04-25T09:40:40.633865+0000","last_fullsized":"2024-04-25T09:40:40.633865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.637157+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:40.637157+0000","last_peered":"2024-04-25T09:40:40.637157+0000","last_clean":"2024-04-25T09:40:40.637157+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:40.637157+0000","last_undegraded":"2024-04-25T09:40:40.637157+0000","last_fullsized":"2024-04-25T09:40:40.637157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"107'47","reported_seq":72,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:41.654547+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:40:41.654547+0000","last_peered":"2024-04-25T09:40:41.654547+0000","last_clean":"2024-04-25T09:40:41.654547+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:40:41.654547+0000","last_undegraded":"2024-04-25T09:40:41.654547+0000","last_fullsized":"2024-04-25T09:40:41.654547+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:40.638658+0000","last_peered":"2024-04-25T09:40:40.638658+0000","last_clean":"2024-04-25T09:40:40.638658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:40.638658+0000","last_undegraded":"2024-04-25T09:40:40.638658+0000","last_fullsized":"2024-04-25T09:40:40.638658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"107'71","reported_seq":92,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.951457+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:40:40.951457+0000","last_peered":"2024-04-25T09:40:40.951457+0000","last_clean":"2024-04-25T09:40:40.951457+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:40:40.951457+0000","last_undegraded":"2024-04-25T09:40:40.951457+0000","last_fullsized":"2024-04-25T09:40:40.951457+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.613724+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:40.613724+0000","last_peered":"2024-04-25T09:40:40.613724+0000","last_clean":"2024-04-25T09:40:40.613724+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:40.613724+0000","last_undegraded":"2024-04-25T09:40:40.613724+0000","last_fullsized":"2024-04-25T09:40:40.613724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"107'99","reported_seq":120,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:46.514811+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:46.514811+0000","last_peered":"2024-04-25T09:40:46.514811+0000","last_clean":"2024-04-25T09:40:46.514811+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:46.514811+0000","last_undegraded":"2024-04-25T09:40:46.514811+0000","last_fullsized":"2024-04-25T09:40:46.514811+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":819200,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638667+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:40.638667+0000","last_peered":"2024-04-25T09:40:40.638667+0000","last_clean":"2024-04-25T09:40:40.638667+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:40.638667+0000","last_undegraded":"2024-04-25T09:40:40.638667+0000","last_fullsized":"2024-04-25T09:40:40.638667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"107'95","reported_seq":116,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:45.952587+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:45.952587+0000","last_peered":"2024-04-25T09:40:45.952587+0000","last_clean":"2024-04-25T09:40:45.952587+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:45.952587+0000","last_undegraded":"2024-04-25T09:40:45.952587+0000","last_fullsized":"2024-04-25T09:40:45.952587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.444828+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:39.444828+0000","last_peered":"2024-04-25T09:40:39.444828+0000","last_clean":"2024-04-25T09:40:39.444828+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:39.444828+0000","last_undegraded":"2024-04-25T09:40:39.444828+0000","last_fullsized":"2024-04-25T09:40:39.444828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"107'79","reported_seq":100,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:44.777521+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:44.777521+0000","last_peered":"2024-04-25T09:40:44.777521+0000","last_clean":"2024-04-25T09:40:44.777521+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:44.777521+0000","last_undegraded":"2024-04-25T09:40:44.777521+0000","last_fullsized":"2024-04-25T09:40:44.777521+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":248,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.655194+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:40.655194+0000","last_peered":"2024-04-25T09:40:40.655194+0000","last_clean":"2024-04-25T09:40:40.655194+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:40.655194+0000","last_undegraded":"2024-04-25T09:40:40.655194+0000","last_fullsized":"2024-04-25T09:40:40.655194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"107'79","reported_seq":100,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:46.079465+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:46.079465+0000","last_peered":"2024-04-25T09:40:46.079465+0000","last_clean":"2024-04-25T09:40:46.079465+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:46.079465+0000","last_undegraded":"2024-04-25T09:40:46.079465+0000","last_fullsized":"2024-04-25T09:40:46.079465+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.420187+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:39.420187+0000","last_peered":"2024-04-25T09:40:39.420187+0000","last_clean":"2024-04-25T09:40:39.420187+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:39.420187+0000","last_undegraded":"2024-04-25T09:40:39.420187+0000","last_fullsized":"2024-04-25T09:40:39.420187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"107'95","reported_seq":116,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:46.239417+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:46.239417+0000","last_peered":"2024-04-25T09:40:46.239417+0000","last_clean":"2024-04-25T09:40:46.239417+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:46.239417+0000","last_undegraded":"2024-04-25T09:40:46.239417+0000","last_fullsized":"2024-04-25T09:40:46.239417+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.623069+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:40.623069+0000","last_peered":"2024-04-25T09:40:40.623069+0000","last_clean":"2024-04-25T09:40:40.623069+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:40.623069+0000","last_undegraded":"2024-04-25T09:40:40.623069+0000","last_fullsized":"2024-04-25T09:40:40.623069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":11239424,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1372,"num_write_kb":10976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15548416,"data_stored":31096832,"data_compressed":1602411,"data_compressed_allocated":15548416,"data_compressed_original":31096832,"omap_allocated":0,"internal_metadata":0},"log_size":1356,"ondisk_log_size":1356,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123744,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94248096,"statfs":{"total":96636764160,"available":96510050304,"internally_reserved":0,"allocated":2580480,"data_stored":4493160,"data_compressed":216863,"data_compressed_allocated":1855488,"data_compressed_original":4202496,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673739,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111416,"kb_used_data":4080,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94260424,"statfs":{"total":96636764160,"available":96522674176,"internally_reserved":0,"allocated":4177920,"data_stored":7688040,"data_compressed":381391,"data_compressed_allocated":3452928,"data_compressed_original":7397376,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112520,"kb_used_data":5184,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94259320,"statfs":{"total":96636764160,"available":96521543680,"internally_reserved":0,"allocated":5308416,"data_stored":9481544,"data_compressed":474560,"data_compressed_allocated":4603904,"data_compressed_original":9207808,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126372,"kb_used_data":5148,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94245468,"statfs":{"total":96636764160,"available":96507359232,"internally_reserved":0,"allocated":5271552,"data_stored":9875304,"data_compressed":494373,"data_compressed_allocated":4546560,"data_compressed_original":9584640,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4882432,"data_stored":9764864,"data_compressed":503322,"data_compressed_allocated":4882432,"data_compressed_original":9764864,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5099520,"data_stored":10199040,"data_compressed":525743,"data_compressed_allocated":5099520,"data_compressed_original":10199040,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3469312,"data_stored":6938624,"data_compressed":357332,"data_compressed_allocated":3469312,"data_compressed_original":6938624,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":4194304,"data_compressed":216014,"data_compressed_allocated":2097152,"data_compressed_original":4194304,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:48.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 15 1781 1766 1.06121 1.05469 0.115358 0.117075 2024-04-25T09:40:49.234 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 1927 1911 1.06632 1.13281 0.0353462 0.116732 2024-04-25T09:40:49.642 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:49.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:49.767+0000 7f055915d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:49.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:49.773+0000 7f055915d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:50.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 2073 2057 1.07126 1.14062 0.122132 0.116216 2024-04-25T09:40:51.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 2201 2185 1.06681 1 0.152035 0.116724 2024-04-25T09:40:52.045 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:52.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:52.183+0000 7f30fb91d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:52.182 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:52.190+0000 7f30fb91d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:52.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 2353 2337 1.0739 1.1875 0.102106 0.116004 2024-04-25T09:40:53.163 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:53.164 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:53.164 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:53.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 2502 2486 1.0789 1.16406 0.0720286 0.115484 2024-04-25T09:40:53.293 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:53.295+0000 7f230b754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:53.298 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:53.304+0000 7f230b754640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:53.509 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:53.510 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:53.529 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2024-04-25T09:40:53.395302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19604000,"num_objects":294,"num_object_clones":0,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2458,"num_write_kb":20462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2402,"ondisk_log_size":2402,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":516916,"kb_used_data":29268,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376970444,"statfs":{"total":386547056640,"available":386017734656,"internally_reserved":0,"allocated":29970432,"data_stored":56802176,"data_compressed":2871603,"data_compressed_allocated":27090944,"data_compressed_original":55656448,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17162240,"num_objects":263,"num_object_clones":0,"num_object_copies":789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2095,"num_write_kb":16760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002461"},"pg_stats":[{"pgid":"10.7","version":"107'71","reported_seq":92,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.512070+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:51.512070+0000","last_peered":"2024-04-25T09:40:51.512070+0000","last_clean":"2024-04-25T09:40:51.512070+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:51.512070+0000","last_undegraded":"2024-04-25T09:40:51.512070+0000","last_fullsized":"2024-04-25T09:40:51.512070+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"107'167","reported_seq":188,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.459844+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:51.459844+0000","last_peered":"2024-04-25T09:40:51.459844+0000","last_clean":"2024-04-25T09:40:51.459844+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:51.459844+0000","last_undegraded":"2024-04-25T09:40:51.459844+0000","last_fullsized":"2024-04-25T09:40:51.459844+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"107'164","reported_seq":189,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.469938+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:40:52.469938+0000","last_peered":"2024-04-25T09:40:52.469938+0000","last_clean":"2024-04-25T09:40:52.469938+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:40:52.469938+0000","last_undegraded":"2024-04-25T09:40:52.469938+0000","last_fullsized":"2024-04-25T09:40:52.469938+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1351680,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":1320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"107'183","reported_seq":204,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.110683+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:40:52.110683+0000","last_peered":"2024-04-25T09:40:52.110683+0000","last_clean":"2024-04-25T09:40:52.110683+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:40:52.110683+0000","last_undegraded":"2024-04-25T09:40:52.110683+0000","last_fullsized":"2024-04-25T09:40:52.110683+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"107'119","reported_seq":140,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.374749+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:51.374749+0000","last_peered":"2024-04-25T09:40:51.374749+0000","last_clean":"2024-04-25T09:40:51.374749+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:51.374749+0000","last_undegraded":"2024-04-25T09:40:51.374749+0000","last_fullsized":"2024-04-25T09:40:51.374749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"107'174","reported_seq":195,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.499445+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:40:52.499445+0000","last_peered":"2024-04-25T09:40:52.499445+0000","last_clean":"2024-04-25T09:40:52.499445+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:40:52.499445+0000","last_undegraded":"2024-04-25T09:40:52.499445+0000","last_fullsized":"2024-04-25T09:40:52.499445+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1433600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":1400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"107'155","reported_seq":176,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.502053+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:51.502053+0000","last_peered":"2024-04-25T09:40:51.502053+0000","last_clean":"2024-04-25T09:40:51.502053+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:51.502053+0000","last_undegraded":"2024-04-25T09:40:51.502053+0000","last_fullsized":"2024-04-25T09:40:51.502053+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277952,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":1248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"107'183","reported_seq":204,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.266757+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:51.266757+0000","last_peered":"2024-04-25T09:40:51.266757+0000","last_clean":"2024-04-25T09:40:51.266757+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:51.266757+0000","last_undegraded":"2024-04-25T09:40:51.266757+0000","last_fullsized":"2024-04-25T09:40:51.266757+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"107'167","reported_seq":188,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.161008+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:51.161008+0000","last_peered":"2024-04-25T09:40:51.161008+0000","last_clean":"2024-04-25T09:40:51.161008+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:51.161008+0000","last_undegraded":"2024-04-25T09:40:51.161008+0000","last_fullsized":"2024-04-25T09:40:51.161008+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":381,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.633865+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:40.633865+0000","last_peered":"2024-04-25T09:40:40.633865+0000","last_clean":"2024-04-25T09:40:40.633865+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:40.633865+0000","last_undegraded":"2024-04-25T09:40:40.633865+0000","last_fullsized":"2024-04-25T09:40:40.633865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.637157+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:40.637157+0000","last_peered":"2024-04-25T09:40:40.637157+0000","last_clean":"2024-04-25T09:40:40.637157+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:40.637157+0000","last_undegraded":"2024-04-25T09:40:40.637157+0000","last_fullsized":"2024-04-25T09:40:40.637157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"107'144","reported_seq":169,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.488422+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:40:52.488422+0000","last_peered":"2024-04-25T09:40:52.488422+0000","last_clean":"2024-04-25T09:40:52.488422+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:40:52.488422+0000","last_undegraded":"2024-04-25T09:40:52.488422+0000","last_fullsized":"2024-04-25T09:40:52.488422+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1187840,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":1160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:40.638658+0000","last_peered":"2024-04-25T09:40:40.638658+0000","last_clean":"2024-04-25T09:40:40.638658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:40.638658+0000","last_undegraded":"2024-04-25T09:40:40.638658+0000","last_fullsized":"2024-04-25T09:40:40.638658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"107'143","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.230749+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:40:52.230749+0000","last_peered":"2024-04-25T09:40:52.230749+0000","last_clean":"2024-04-25T09:40:52.230749+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:40:52.230749+0000","last_undegraded":"2024-04-25T09:40:52.230749+0000","last_fullsized":"2024-04-25T09:40:52.230749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.613724+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:40.613724+0000","last_peered":"2024-04-25T09:40:40.613724+0000","last_clean":"2024-04-25T09:40:40.613724+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:40.613724+0000","last_undegraded":"2024-04-25T09:40:40.613724+0000","last_fullsized":"2024-04-25T09:40:40.613724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"107'143","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:50.691492+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:50.691492+0000","last_peered":"2024-04-25T09:40:50.691492+0000","last_clean":"2024-04-25T09:40:50.691492+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:50.691492+0000","last_undegraded":"2024-04-25T09:40:50.691492+0000","last_fullsized":"2024-04-25T09:40:50.691492+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638667+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:40.638667+0000","last_peered":"2024-04-25T09:40:40.638667+0000","last_clean":"2024-04-25T09:40:40.638667+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:40.638667+0000","last_undegraded":"2024-04-25T09:40:40.638667+0000","last_fullsized":"2024-04-25T09:40:40.638667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"107'127","reported_seq":148,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:50.891635+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:50.891635+0000","last_peered":"2024-04-25T09:40:50.891635+0000","last_clean":"2024-04-25T09:40:50.891635+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:50.891635+0000","last_undegraded":"2024-04-25T09:40:50.891635+0000","last_fullsized":"2024-04-25T09:40:50.891635+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.444828+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:39.444828+0000","last_peered":"2024-04-25T09:40:39.444828+0000","last_clean":"2024-04-25T09:40:39.444828+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:39.444828+0000","last_undegraded":"2024-04-25T09:40:39.444828+0000","last_fullsized":"2024-04-25T09:40:39.444828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"107'119","reported_seq":140,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.124472+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:51.124472+0000","last_peered":"2024-04-25T09:40:51.124472+0000","last_clean":"2024-04-25T09:40:51.124472+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:51.124472+0000","last_undegraded":"2024-04-25T09:40:51.124472+0000","last_fullsized":"2024-04-25T09:40:51.124472+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":248,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.655194+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:40.655194+0000","last_peered":"2024-04-25T09:40:40.655194+0000","last_clean":"2024-04-25T09:40:40.655194+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:40.655194+0000","last_undegraded":"2024-04-25T09:40:40.655194+0000","last_fullsized":"2024-04-25T09:40:40.655194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"107'103","reported_seq":124,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:51.429621+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:51.429621+0000","last_peered":"2024-04-25T09:40:51.429621+0000","last_clean":"2024-04-25T09:40:51.429621+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:51.429621+0000","last_undegraded":"2024-04-25T09:40:51.429621+0000","last_fullsized":"2024-04-25T09:40:51.429621+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.420187+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:39.420187+0000","last_peered":"2024-04-25T09:40:39.420187+0000","last_clean":"2024-04-25T09:40:39.420187+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:39.420187+0000","last_undegraded":"2024-04-25T09:40:39.420187+0000","last_fullsized":"2024-04-25T09:40:39.420187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"107'143","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:50.791989+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:50.791989+0000","last_peered":"2024-04-25T09:40:50.791989+0000","last_clean":"2024-04-25T09:40:50.791989+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:50.791989+0000","last_undegraded":"2024-04-25T09:40:50.791989+0000","last_fullsized":"2024-04-25T09:40:50.791989+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.623069+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:40.623069+0000","last_peered":"2024-04-25T09:40:40.623069+0000","last_clean":"2024-04-25T09:40:40.623069+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:40.623069+0000","last_undegraded":"2024-04-25T09:40:40.623069+0000","last_fullsized":"2024-04-25T09:40:40.623069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":19013632,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2321,"num_write_kb":18568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28278784,"data_stored":56557568,"data_compressed":2917062,"data_compressed_allocated":28278784,"data_compressed_original":56557568,"omap_allocated":0,"internal_metadata":0},"log_size":2305,"ondisk_log_size":2305,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131008,"kb_used_data":5624,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94240832,"statfs":{"total":96636764160,"available":96502611968,"internally_reserved":0,"allocated":5758976,"data_stored":10850152,"data_compressed":545026,"data_compressed_allocated":5033984,"data_compressed_original":10559488,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120404,"kb_used_data":8908,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94251436,"statfs":{"total":96636764160,"available":96513470464,"internally_reserved":0,"allocated":9121792,"data_stored":17575784,"data_compressed":891921,"data_compressed_allocated":8396800,"data_compressed_original":17285120,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136952,"kb_used_data":7408,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94234888,"statfs":{"total":96636764160,"available":96496525312,"internally_reserved":0,"allocated":7585792,"data_stored":14036296,"data_compressed":709748,"data_compressed_allocated":6881280,"data_compressed_original":13762560,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128552,"kb_used_data":7328,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94243288,"statfs":{"total":96636764160,"available":96505126912,"internally_reserved":0,"allocated":7503872,"data_stored":14339944,"data_compressed":724908,"data_compressed_allocated":6778880,"data_compressed_original":14049280,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":14393344,"data_compressed":742317,"data_compressed_allocated":7196672,"data_compressed_original":14393344,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7307264,"data_stored":14614528,"data_compressed":753740,"data_compressed_allocated":7307264,"data_compressed_original":14614528,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8445952,"data_stored":16891904,"data_compressed":871260,"data_compressed_allocated":8445952,"data_compressed_original":16891904,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5328896,"data_stored":10657792,"data_compressed":549745,"data_compressed_allocated":5328896,"data_compressed_original":10657792,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:54.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 2620 2604 1.07064 0.921875 0.0578292 0.11608 2024-04-25T09:40:54.363 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:54.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:54.486+0000 7fb1a275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:54.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:54.493+0000 7fb1a275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:55.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:40:55.243303+0000 min lat: 0.0162562 max lat: 0.39012 avg lat: 0.115805 2024-04-25T09:40:55.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:40:55.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 2770 2754 1.07569 1.17188 0.0864282 0.115805 2024-04-25T09:40:56.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 2907 2891 1.07543 1.07031 0.0909448 0.11585 2024-04-25T09:40:56.714 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:40:56.844 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:56.848+0000 7f795875d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:56.849 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:56.855+0000 7f795875d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:57.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 3050 3034 1.07732 1.11719 0.109049 0.11566 2024-04-25T09:40:58.235 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 3196 3180 1.08007 1.14062 0.073165 0.115418 2024-04-25T09:40:58.530 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:40:58.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:40:58.531 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:40:58.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:58.651+0000 7f67c0224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:58.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:58.661+0000 7f67c0224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:58.875 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:40:58.876 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:40:58.890 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-04-25T09:40:57.396142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":23454240,"num_objects":354,"num_object_clones":0,"num_object_copies":1062,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2928,"num_write_kb":24222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2872,"ondisk_log_size":2872,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":525752,"kb_used_data":33944,"kb_used_omap":0,"kb_used_meta":491776,"kb_avail":376961608,"statfs":{"total":386547056640,"available":386008686592,"internally_reserved":0,"allocated":34758656,"data_stored":66378624,"data_compressed":3366090,"data_compressed_allocated":31879168,"data_compressed_original":65232896,"omap_allocated":0,"internal_metadata":503578624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15466496,"num_objects":238,"num_object_clones":0,"num_object_copies":714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1888,"num_write_kb":15104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002397"},"pg_stats":[{"pgid":"10.7","version":"107'103","reported_seq":124,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.532448+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:40:56.532448+0000","last_peered":"2024-04-25T09:40:56.532448+0000","last_clean":"2024-04-25T09:40:56.532448+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:40:56.532448+0000","last_undegraded":"2024-04-25T09:40:56.532448+0000","last_fullsized":"2024-04-25T09:40:56.532448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"107'223","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.245786+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:40:56.245786+0000","last_peered":"2024-04-25T09:40:56.245786+0000","last_clean":"2024-04-25T09:40:56.245786+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:40:56.245786+0000","last_undegraded":"2024-04-25T09:40:56.245786+0000","last_fullsized":"2024-04-25T09:40:56.245786+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"107'164","reported_seq":189,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.469938+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:40:52.469938+0000","last_peered":"2024-04-25T09:40:52.469938+0000","last_clean":"2024-04-25T09:40:52.469938+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:40:52.469938+0000","last_undegraded":"2024-04-25T09:40:52.469938+0000","last_fullsized":"2024-04-25T09:40:52.469938+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1351680,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":1320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"107'183","reported_seq":204,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.110683+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:40:52.110683+0000","last_peered":"2024-04-25T09:40:52.110683+0000","last_clean":"2024-04-25T09:40:52.110683+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:40:52.110683+0000","last_undegraded":"2024-04-25T09:40:52.110683+0000","last_fullsized":"2024-04-25T09:40:52.110683+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"107'137","reported_seq":158,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.496017+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:40:56.496017+0000","last_peered":"2024-04-25T09:40:56.496017+0000","last_clean":"2024-04-25T09:40:56.496017+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:40:56.496017+0000","last_undegraded":"2024-04-25T09:40:56.496017+0000","last_fullsized":"2024-04-25T09:40:56.496017+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1130496,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":1104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"107'174","reported_seq":195,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.499445+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:40:52.499445+0000","last_peered":"2024-04-25T09:40:52.499445+0000","last_clean":"2024-04-25T09:40:52.499445+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:40:52.499445+0000","last_undegraded":"2024-04-25T09:40:52.499445+0000","last_fullsized":"2024-04-25T09:40:52.499445+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1433600,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":1400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"107'239","reported_seq":260,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.050493+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:40:56.050493+0000","last_peered":"2024-04-25T09:40:56.050493+0000","last_clean":"2024-04-25T09:40:56.050493+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:40:56.050493+0000","last_undegraded":"2024-04-25T09:40:56.050493+0000","last_fullsized":"2024-04-25T09:40:56.050493+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":240,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"107'255","reported_seq":276,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:55.717993+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:40:55.717993+0000","last_peered":"2024-04-25T09:40:55.717993+0000","last_clean":"2024-04-25T09:40:55.717993+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:40:55.717993+0000","last_undegraded":"2024-04-25T09:40:55.717993+0000","last_fullsized":"2024-04-25T09:40:55.717993+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"107'185","reported_seq":206,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.483611+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:40:56.483611+0000","last_peered":"2024-04-25T09:40:56.483611+0000","last_clean":"2024-04-25T09:40:56.483611+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:40:56.483611+0000","last_undegraded":"2024-04-25T09:40:56.483611+0000","last_fullsized":"2024-04-25T09:40:56.483611+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523712,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":381,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.633865+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:40.633865+0000","last_peered":"2024-04-25T09:40:40.633865+0000","last_clean":"2024-04-25T09:40:40.633865+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:40.633865+0000","last_undegraded":"2024-04-25T09:40:40.633865+0000","last_fullsized":"2024-04-25T09:40:40.633865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.637157+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:40.637157+0000","last_peered":"2024-04-25T09:40:40.637157+0000","last_clean":"2024-04-25T09:40:40.637157+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:40.637157+0000","last_undegraded":"2024-04-25T09:40:40.637157+0000","last_fullsized":"2024-04-25T09:40:40.637157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"107'144","reported_seq":169,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.488422+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:40:52.488422+0000","last_peered":"2024-04-25T09:40:52.488422+0000","last_clean":"2024-04-25T09:40:52.488422+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:40:52.488422+0000","last_undegraded":"2024-04-25T09:40:52.488422+0000","last_fullsized":"2024-04-25T09:40:52.488422+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1187840,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":1160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:40.638658+0000","last_peered":"2024-04-25T09:40:40.638658+0000","last_clean":"2024-04-25T09:40:40.638658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:40.638658+0000","last_undegraded":"2024-04-25T09:40:40.638658+0000","last_fullsized":"2024-04-25T09:40:40.638658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"107'143","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:52.230749+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:40:52.230749+0000","last_peered":"2024-04-25T09:40:52.230749+0000","last_clean":"2024-04-25T09:40:52.230749+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:40:52.230749+0000","last_undegraded":"2024-04-25T09:40:52.230749+0000","last_fullsized":"2024-04-25T09:40:52.230749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.613724+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:40.613724+0000","last_peered":"2024-04-25T09:40:40.613724+0000","last_clean":"2024-04-25T09:40:40.613724+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:40.613724+0000","last_undegraded":"2024-04-25T09:40:40.613724+0000","last_fullsized":"2024-04-25T09:40:40.613724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"107'215","reported_seq":236,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.353092+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:40:56.353092+0000","last_peered":"2024-04-25T09:40:56.353092+0000","last_clean":"2024-04-25T09:40:56.353092+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:40:56.353092+0000","last_undegraded":"2024-04-25T09:40:56.353092+0000","last_fullsized":"2024-04-25T09:40:56.353092+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638667+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:40.638667+0000","last_peered":"2024-04-25T09:40:40.638667+0000","last_clean":"2024-04-25T09:40:40.638667+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:40.638667+0000","last_undegraded":"2024-04-25T09:40:40.638667+0000","last_fullsized":"2024-04-25T09:40:40.638667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"107'151","reported_seq":172,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.421681+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:40:56.421681+0000","last_peered":"2024-04-25T09:40:56.421681+0000","last_clean":"2024-04-25T09:40:56.421681+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:40:56.421681+0000","last_undegraded":"2024-04-25T09:40:56.421681+0000","last_fullsized":"2024-04-25T09:40:56.421681+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.444828+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:39.444828+0000","last_peered":"2024-04-25T09:40:39.444828+0000","last_clean":"2024-04-25T09:40:39.444828+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:39.444828+0000","last_undegraded":"2024-04-25T09:40:39.444828+0000","last_fullsized":"2024-04-25T09:40:39.444828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"107'151","reported_seq":172,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.120512+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:40:56.120512+0000","last_peered":"2024-04-25T09:40:56.120512+0000","last_clean":"2024-04-25T09:40:56.120512+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:40:56.120512+0000","last_undegraded":"2024-04-25T09:40:56.120512+0000","last_fullsized":"2024-04-25T09:40:56.120512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":248,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.655194+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:40.655194+0000","last_peered":"2024-04-25T09:40:40.655194+0000","last_clean":"2024-04-25T09:40:40.655194+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:40.655194+0000","last_undegraded":"2024-04-25T09:40:40.655194+0000","last_fullsized":"2024-04-25T09:40:40.655194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"107'143","reported_seq":164,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:55.461443+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:40:55.461443+0000","last_peered":"2024-04-25T09:40:55.461443+0000","last_clean":"2024-04-25T09:40:55.461443+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:40:55.461443+0000","last_undegraded":"2024-04-25T09:40:55.461443+0000","last_fullsized":"2024-04-25T09:40:55.461443+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.420187+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:39.420187+0000","last_peered":"2024-04-25T09:40:39.420187+0000","last_clean":"2024-04-25T09:40:39.420187+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:39.420187+0000","last_undegraded":"2024-04-25T09:40:39.420187+0000","last_fullsized":"2024-04-25T09:40:39.420187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"107'165","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:56.470732+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:40:56.470732+0000","last_peered":"2024-04-25T09:40:56.470732+0000","last_clean":"2024-04-25T09:40:56.470732+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:40:56.470732+0000","last_undegraded":"2024-04-25T09:40:56.470732+0000","last_fullsized":"2024-04-25T09:40:56.470732+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1359872,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":1328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.623069+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:40.623069+0000","last_peered":"2024-04-25T09:40:40.623069+0000","last_clean":"2024-04-25T09:40:40.623069+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:40.623069+0000","last_undegraded":"2024-04-25T09:40:40.623069+0000","last_fullsized":"2024-04-25T09:40:40.623069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":22863872,"num_objects":352,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2791,"num_write_kb":22328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33079296,"data_stored":66158592,"data_compressed":3412818,"data_compressed_allocated":33079296,"data_compressed_original":66158592,"omap_allocated":0,"internal_metadata":0},"log_size":2775,"ondisk_log_size":2775,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131008,"kb_used_data":5624,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94240832,"statfs":{"total":96636764160,"available":96502611968,"internally_reserved":0,"allocated":5758976,"data_stored":10850152,"data_compressed":545026,"data_compressed_allocated":5033984,"data_compressed_original":10559488,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":120404,"kb_used_data":8908,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94251436,"statfs":{"total":96636764160,"available":96513470464,"internally_reserved":0,"allocated":9121792,"data_stored":17575784,"data_compressed":891921,"data_compressed_allocated":8396800,"data_compressed_original":17285120,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139188,"kb_used_data":9644,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94232652,"statfs":{"total":96636764160,"available":96494235648,"internally_reserved":0,"allocated":9875456,"data_stored":18615624,"data_compressed":946205,"data_compressed_allocated":9170944,"data_compressed_original":18341888,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135152,"kb_used_data":9768,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94236688,"statfs":{"total":96636764160,"available":96498368512,"internally_reserved":0,"allocated":10002432,"data_stored":19337064,"data_compressed":982938,"data_compressed_allocated":9277440,"data_compressed_original":19046400,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9670656,"data_stored":19341312,"data_compressed":997809,"data_compressed_allocated":9670656,"data_compressed_original":19341312,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9633792,"data_stored":19267584,"data_compressed":994004,"data_compressed_allocated":9633792,"data_compressed_original":19267584,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8445952,"data_stored":16891904,"data_compressed":871260,"data_compressed_allocated":8445952,"data_compressed_original":16891904,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5328896,"data_stored":10657792,"data_compressed":549745,"data_compressed_allocated":5328896,"data_compressed_original":10657792,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:40:59.055 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:40:59.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:59.182+0000 7f09dfc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:59.181 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:40:59.188+0000 7f09dfc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:40:59.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 3321 3305 1.07575 0.976562 0.132505 0.115908 2024-04-25T09:41:00.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 3459 3443 1.07584 1.07812 0.102121 0.115724 2024-04-25T09:41:01.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 3601 3585 1.07713 1.10938 0.16557 0.115726 2024-04-25T09:41:01.368 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:01.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:01.491+0000 7efdd275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:01.492 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:01.498+0000 7efdd275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:02.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 3733 3717 1.07543 1.03125 0.182412 0.115922 2024-04-25T09:41:03.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 3865 3849 1.07384 1.03125 0.0503893 0.11608 2024-04-25T09:41:03.705 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:03.822 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:03.827+0000 7f0959d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:03.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:03.833+0000 7f0959d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:03.893 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:03.893 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:03.893 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:03.893 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:04.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.022+0000 7f6a9e62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.033+0000 7f6a9e62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:04.061 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:04.062 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:04.062 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:04.064 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:04.064 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:04.065 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:04.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.197+0000 7fadedd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.207+0000 7fadedd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 4007 3991 1.07507 1.10938 0.211778 0.116039 2024-04-25T09:41:04.283 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:04.283 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:04.283 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:04.283 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:04.283 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:04.284 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:04.286 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:04.286 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:04.287 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:04.407 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.407+0000 7f8e318ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.412 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.419+0000 7f8e318ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:04.432 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:04.433 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:04.435 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:04.435 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:04.435 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:04.563 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.564+0000 7fc2dae6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:04.575+0000 7fc2dae6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:04.688 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:04.689 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:04.691 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:04.691 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:05.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 4142 4126 1.07438 1.05469 0.021705 0.115935 2024-04-25T09:41:06.110 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:06.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 4272 4256 1.07249 1.01562 0.117213 0.116323 2024-04-25T09:41:06.238 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:06.242+0000 7f411d664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:06.242 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:06.249+0000 7f411d664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:07.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 4389 4373 1.06753 0.914062 0.236099 0.116859 2024-04-25T09:41:08.236 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 4534 4518 1.06951 1.13281 0.103804 0.116694 2024-04-25T09:41:08.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:08.514 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:08.518+0000 7fb03f0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:08.518 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:08.525+0000 7fb03f0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:09.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 4667 4651 1.06861 1.03906 0.148293 0.116757 2024-04-25T09:41:09.692 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:09.692 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:09.692 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:09.692 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:09.823 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:09.822+0000 7f4855d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:09.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:09.835+0000 7f4855d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:09.891 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:09.891 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:09.892 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:09.894 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:09.895 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:09.895 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:10.033 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.031+0000 7fd1d7a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:10.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.044+0000 7fd1d7a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:10.062 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:10.063 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:10.063 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:10.063 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:10.065 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:10.065 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:10.065 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:10.224 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.224+0000 7f40830ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:10.229 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.235+0000 7f40830ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:10.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 4793 4777 1.0662 0.984375 0.178318 0.11693 2024-04-25T09:41:10.249 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:10.249 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:10.250 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:10.252 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:10.253 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:10.253 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:10.384 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.384+0000 7f7e406ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:10.388 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.395+0000 7f7e406ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:10.408 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:10.408 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:10.408 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:10.409 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:10.411 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:10.412 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:10.716 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:10.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.843+0000 7f234735d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:10.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:10.849+0000 7f234735d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:11.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 4909 4893 1.06176 0.90625 0.0370933 0.117487 2024-04-25T09:41:12.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 5026 5010 1.05776 0.914062 0.170271 0.117866 2024-04-25T09:41:12.992 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:13.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:13.144+0000 7f3056cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:13.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:13.150+0000 7f3056cad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:13.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 5158 5142 1.05706 1.03125 0.132607 0.117963 2024-04-25T09:41:14.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 5301 5285 1.0586 1.11719 0.121056 0.117887 2024-04-25T09:41:15.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:41:15.245156+0000 min lat: 0.0162562 max lat: 0.39012 avg lat: 0.118138 2024-04-25T09:41:15.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:41:15.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 5425 5409 1.05635 0.96875 0.150545 0.118138 2024-04-25T09:41:15.331 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:15.413 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:15.413 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:15.413 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:15.413 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:15.459 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:15.463+0000 7f49fdc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:15.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:15.470+0000 7f49fdc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:15.586 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:15.586+0000 7f5187bd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:15.592 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:15.599+0000 7f5187bd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:15.631 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:15.631 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:15.632 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:15.635 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:15.635 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:15.635 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:15.762 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:15.762+0000 7f83b6464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:15.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:15.773+0000 7f83b6464640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:15.892 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:15.893 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:15.896 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:15.896 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:15.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:16.068 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:16.068+0000 7f332959d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:16.073 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:16.080+0000 7f332959d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:16.094 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:16.094 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:16.095 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:16.097 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:16.097 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:16.098 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:16.222 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:16.223+0000 7f1dffa6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:16.228 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:16.235+0000 7f1dffa6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:16.237 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 5553 5537 1.05498 1 0.11152 0.118251 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:16.326 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:16.327 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:16.327 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:16.327 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:16.330 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:16.331 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:17.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 5690 5674 1.05534 1.07031 0.100273 0.118277 2024-04-25T09:41:17.760 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:17.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:17.887+0000 7ff3925ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:17.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:17.894+0000 7ff3925ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:18.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 5812 5796 1.05296 0.953125 0.100787 0.118473 2024-04-25T09:41:19.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 5950 5934 1.05353 1.07812 0.106455 0.118413 2024-04-25T09:41:20.147 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:20.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 6090 6074 1.05442 1.09375 0.0439156 0.118379 2024-04-25T09:41:20.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:20.271+0000 7f8594c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:20.270 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:20.277+0000 7f8594c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:21.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 6230 6214 1.05527 1.09375 0.119324 0.118266 2024-04-25T09:41:21.332 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:21.332 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:21.333 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:41:21.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:21.486+0000 7f123339d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:21.493 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:21.499+0000 7f123339d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:21.719 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:41:21.720 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:41:21.736 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2024-04-25T09:41:21.401236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":46572064,"num_objects":705,"num_object_clones":0,"num_object_copies":2115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":5750,"num_write_kb":46798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5694,"ondisk_log_size":5694,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":544676,"kb_used_data":69504,"kb_used_omap":0,"kb_used_meta":475136,"kb_avail":376942684,"statfs":{"total":386547056640,"available":385989308416,"internally_reserved":0,"allocated":71172096,"data_stored":139205504,"data_compressed":7126560,"data_compressed_allocated":68292608,"data_compressed_original":138059776,"omap_allocated":0,"internal_metadata":486539264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10641408,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1299,"num_write_kb":10392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002623"},"pg_stats":[{"pgid":"10.7","version":"107'228","reported_seq":249,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.506816+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:41:16.506816+0000","last_peered":"2024-04-25T09:41:16.506816+0000","last_clean":"2024-04-25T09:41:16.506816+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:41:16.506816+0000","last_undegraded":"2024-04-25T09:41:16.506816+0000","last_fullsized":"2024-04-25T09:41:16.506816+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1875968,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":229,"num_write_kb":1832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"107'367","reported_seq":388,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.026451+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:41:16.026451+0000","last_peered":"2024-04-25T09:41:16.026451+0000","last_clean":"2024-04-25T09:41:16.026451+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:41:16.026451+0000","last_undegraded":"2024-04-25T09:41:16.026451+0000","last_fullsized":"2024-04-25T09:41:16.026451+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"107'351","reported_seq":376,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:14.263592+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:41:14.263592+0000","last_peered":"2024-04-25T09:41:14.263592+0000","last_clean":"2024-04-25T09:41:14.263592+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:41:14.263592+0000","last_undegraded":"2024-04-25T09:41:14.263592+0000","last_fullsized":"2024-04-25T09:41:14.263592+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"107'351","reported_seq":372,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.375009+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:41:16.375009+0000","last_peered":"2024-04-25T09:41:16.375009+0000","last_clean":"2024-04-25T09:41:16.375009+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:41:16.375009+0000","last_undegraded":"2024-04-25T09:41:16.375009+0000","last_fullsized":"2024-04-25T09:41:16.375009+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"107'263","reported_seq":284,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:15.262669+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:41:15.262669+0000","last_peered":"2024-04-25T09:41:15.262669+0000","last_clean":"2024-04-25T09:41:15.262669+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:41:15.262669+0000","last_undegraded":"2024-04-25T09:41:15.262669+0000","last_fullsized":"2024-04-25T09:41:15.262669+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"107'368","reported_seq":389,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.586667+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:41:16.586667+0000","last_peered":"2024-04-25T09:41:16.586667+0000","last_clean":"2024-04-25T09:41:16.586667+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:41:16.586667+0000","last_undegraded":"2024-04-25T09:41:16.586667+0000","last_fullsized":"2024-04-25T09:41:16.586667+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3022848,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":369,"num_write_kb":2952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"107'455","reported_seq":476,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.015750+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:41:16.015750+0000","last_peered":"2024-04-25T09:41:16.015750+0000","last_clean":"2024-04-25T09:41:16.015750+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:41:16.015750+0000","last_undegraded":"2024-04-25T09:41:16.015750+0000","last_fullsized":"2024-04-25T09:41:16.015750+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"107'399","reported_seq":420,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:15.050309+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:41:15.050309+0000","last_peered":"2024-04-25T09:41:15.050309+0000","last_clean":"2024-04-25T09:41:15.050309+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:41:15.050309+0000","last_undegraded":"2024-04-25T09:41:15.050309+0000","last_fullsized":"2024-04-25T09:41:15.050309+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"107'367","reported_seq":388,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:15.132336+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:41:15.132336+0000","last_peered":"2024-04-25T09:41:15.132336+0000","last_clean":"2024-04-25T09:41:15.132336+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:41:15.132336+0000","last_undegraded":"2024-04-25T09:41:15.132336+0000","last_fullsized":"2024-04-25T09:41:15.132336+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3014656,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":381,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.633865+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:40.633865+0000","last_peered":"2024-04-25T09:40:40.633865+0000","last_clean":"2024-04-25T09:40:40.633865+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:40.633865+0000","last_undegraded":"2024-04-25T09:40:40.633865+0000","last_fullsized":"2024-04-25T09:40:40.633865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.637157+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:40.637157+0000","last_peered":"2024-04-25T09:40:40.637157+0000","last_clean":"2024-04-25T09:40:40.637157+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:40.637157+0000","last_undegraded":"2024-04-25T09:40:40.637157+0000","last_fullsized":"2024-04-25T09:40:40.637157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"107'359","reported_seq":384,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.770117+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:41:16.770117+0000","last_peered":"2024-04-25T09:41:16.770117+0000","last_clean":"2024-04-25T09:41:16.770117+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:41:16.770117+0000","last_undegraded":"2024-04-25T09:41:16.770117+0000","last_fullsized":"2024-04-25T09:41:16.770117+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:40.638658+0000","last_peered":"2024-04-25T09:40:40.638658+0000","last_clean":"2024-04-25T09:40:40.638658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:40.638658+0000","last_undegraded":"2024-04-25T09:40:40.638658+0000","last_fullsized":"2024-04-25T09:40:40.638658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"107'430","reported_seq":451,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:17.458793+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:41:17.458793+0000","last_peered":"2024-04-25T09:41:17.458793+0000","last_clean":"2024-04-25T09:41:17.458793+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:41:17.458793+0000","last_undegraded":"2024-04-25T09:41:17.458793+0000","last_fullsized":"2024-04-25T09:41:17.458793+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3530752,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":431,"num_write_kb":3448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.613724+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:40.613724+0000","last_peered":"2024-04-25T09:40:40.613724+0000","last_clean":"2024-04-25T09:40:40.613724+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:40.613724+0000","last_undegraded":"2024-04-25T09:40:40.613724+0000","last_fullsized":"2024-04-25T09:40:40.613724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"107'399","reported_seq":420,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.275649+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:41:16.275649+0000","last_peered":"2024-04-25T09:41:16.275649+0000","last_clean":"2024-04-25T09:41:16.275649+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:41:16.275649+0000","last_undegraded":"2024-04-25T09:41:16.275649+0000","last_fullsized":"2024-04-25T09:41:16.275649+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638667+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:40.638667+0000","last_peered":"2024-04-25T09:40:40.638667+0000","last_clean":"2024-04-25T09:40:40.638667+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:40.638667+0000","last_undegraded":"2024-04-25T09:40:40.638667+0000","last_fullsized":"2024-04-25T09:40:40.638667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"107'343","reported_seq":364,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.417999+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:41:16.417999+0000","last_peered":"2024-04-25T09:41:16.417999+0000","last_clean":"2024-04-25T09:41:16.417999+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:41:16.417999+0000","last_undegraded":"2024-04-25T09:41:16.417999+0000","last_fullsized":"2024-04-25T09:41:16.417999+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.444828+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:39.444828+0000","last_peered":"2024-04-25T09:40:39.444828+0000","last_clean":"2024-04-25T09:40:39.444828+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:39.444828+0000","last_undegraded":"2024-04-25T09:40:39.444828+0000","last_fullsized":"2024-04-25T09:40:39.444828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"107'279","reported_seq":300,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.160927+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:41:16.160927+0000","last_peered":"2024-04-25T09:41:16.160927+0000","last_clean":"2024-04-25T09:41:16.160927+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:41:16.160927+0000","last_undegraded":"2024-04-25T09:41:16.160927+0000","last_fullsized":"2024-04-25T09:41:16.160927+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":248,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.655194+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:40.655194+0000","last_peered":"2024-04-25T09:40:40.655194+0000","last_clean":"2024-04-25T09:40:40.655194+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:40.655194+0000","last_undegraded":"2024-04-25T09:40:40.655194+0000","last_fullsized":"2024-04-25T09:40:40.655194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"107'335","reported_seq":356,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:15.878507+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:41:15.878507+0000","last_peered":"2024-04-25T09:41:15.878507+0000","last_clean":"2024-04-25T09:41:15.878507+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:41:15.878507+0000","last_undegraded":"2024-04-25T09:41:15.878507+0000","last_fullsized":"2024-04-25T09:41:15.878507+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.420187+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:39.420187+0000","last_peered":"2024-04-25T09:40:39.420187+0000","last_clean":"2024-04-25T09:40:39.420187+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:39.420187+0000","last_undegraded":"2024-04-25T09:40:39.420187+0000","last_fullsized":"2024-04-25T09:40:39.420187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"107'303","reported_seq":324,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:16.443552+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:41:16.443552+0000","last_peered":"2024-04-25T09:41:16.443552+0000","last_clean":"2024-04-25T09:41:16.443552+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:41:16.443552+0000","last_undegraded":"2024-04-25T09:41:16.443552+0000","last_fullsized":"2024-04-25T09:41:16.443552+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.623069+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:40.623069+0000","last_peered":"2024-04-25T09:40:40.623069+0000","last_clean":"2024-04-25T09:40:40.623069+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:40.623069+0000","last_undegraded":"2024-04-25T09:40:40.623069+0000","last_fullsized":"2024-04-25T09:40:40.623069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":45981696,"num_objects":703,"num_object_clones":0,"num_object_copies":2109,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5613,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69304320,"data_stored":138608640,"data_compressed":7153830,"data_compressed_allocated":69304320,"data_compressed_original":138608640,"omap_allocated":0,"internal_metadata":0},"log_size":5597,"ondisk_log_size":5597,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142480,"kb_used_data":12932,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94229360,"statfs":{"total":96636764160,"available":96490864640,"internally_reserved":0,"allocated":13242368,"data_stored":25816936,"data_compressed":1317847,"data_compressed_allocated":12517376,"data_compressed_original":25526272,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673774,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123504,"kb_used_data":20328,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94248336,"statfs":{"total":96636764160,"available":96510296064,"internally_reserved":0,"allocated":20815872,"data_stored":40963944,"data_compressed":2099586,"data_compressed_allocated":20090880,"data_compressed_original":40673280,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143260,"kb_used_data":17876,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94228580,"statfs":{"total":96636764160,"available":96490065920,"internally_reserved":0,"allocated":18305024,"data_stored":35474760,"data_compressed":1816739,"data_compressed_allocated":17600512,"data_compressed_original":35201024,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135432,"kb_used_data":18368,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94236408,"statfs":{"total":96636764160,"available":96498081792,"internally_reserved":0,"allocated":18808832,"data_stored":36949864,"data_compressed":1892388,"data_compressed_allocated":18083840,"data_compressed_original":36659200,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18472960,"data_stored":36945920,"data_compressed":1906836,"data_compressed_allocated":18472960,"data_compressed_original":36945920,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17985536,"data_stored":35971072,"data_compressed":1856501,"data_compressed_allocated":17985536,"data_compressed_original":35971072,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20123648,"data_stored":40247296,"data_compressed":2077233,"data_compressed_allocated":20123648,"data_compressed_original":40247296,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12722176,"data_stored":25444352,"data_compressed":1313260,"data_compressed_allocated":12722176,"data_compressed_original":25444352,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:41:22.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 6359 6343 1.05426 1.00781 0.0741882 0.118368 2024-04-25T09:41:22.515 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:22.643 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:22.647+0000 7fbd3739d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:22.648 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:22.654+0000 7fbd3739d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:23.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 6471 6455 1.05053 0.875 0.148718 0.118793 2024-04-25T09:41:24.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 6599 6583 1.04949 1 0.128558 0.118917 2024-04-25T09:41:24.832 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:24.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:24.956+0000 7fb786aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:24.957 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:24.963+0000 7fb786aed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:25.238 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 6724 6708 1.04803 0.976562 0.0928952 0.119041 2024-04-25T09:41:26.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 6872 6856 1.05015 1.15625 0.122889 0.118838 2024-04-25T09:41:26.738 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:26.739 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:26.739 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:26.739 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:26.860 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:26.860+0000 7f94adead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:26.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:26.870+0000 7f94adead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:26.993 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:26.995 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:26.996 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:26.996 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:27.120 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:27.130 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.127+0000 7f854606d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.143+0000 7f854606d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 6991 6975 1.04783 0.929688 0.152623 0.119111 2024-04-25T09:41:27.244 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.248+0000 7f27d182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.249 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.255+0000 7f27d182d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:27.252 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:27.253 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:27.253 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:27.253 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:27.253 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:27.256 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:27.256 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:27.256 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:27.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.433+0000 7fa560eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.438 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.444+0000 7fa560eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.471 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:27.471 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:27.471 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:27.471 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:27.472 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:27.474 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:27.474 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:27.475 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:27.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.602+0000 7f220411d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.609 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:27.615+0000 7f220411d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:27.731 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:27.732 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:27.734 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:27.735 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:28.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 7127 7111 1.04811 1.0625 0.0982131 0.119082 2024-04-25T09:41:29.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 7263 7247 1.04837 1.0625 0.165354 0.11908 2024-04-25T09:41:29.518 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:29.647 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:29.651+0000 7fc873b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:29.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:29.658+0000 7fc873b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:30.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 7389 7373 1.04721 0.984375 0.034651 0.119202 2024-04-25T09:41:31.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 7514 7498 1.04594 0.976562 0.0876536 0.119368 2024-04-25T09:41:31.814 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:31.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:31.952+0000 7fbfe1b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:31.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:31.959+0000 7fbfe1b9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:32.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 7645 7629 1.04555 1.02344 0.180983 0.119366 2024-04-25T09:41:32.736 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:32.736 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:32.736 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:32.737 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:32.898 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:32.896+0000 7fc8952ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:32.902 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:32.908+0000 7fc8952ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:32.956 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:32.956 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:32.956 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:32.956 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:32.957 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:32.959 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:32.959 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:32.960 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:33.091 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:33.090+0000 7f989fc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:33.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:33.101+0000 7f989fc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:33.135 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:33.136 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:33.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:33.139 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:33.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:33.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 7772 7756 1.04463 0.992188 0.0936265 0.11948 2024-04-25T09:41:33.268 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:33.267+0000 7f5fd186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:33.272 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:33.279+0000 7f5fd186d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:33.291 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:33.291 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:33.291 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:33.291 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:33.291 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:33.291 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:33.292 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:33.292 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:33.292 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:33.292 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:33.292 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:33.292 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:33.294 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:33.295 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:33.295 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:33.433 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:33.432+0000 7f3e742ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:33.437 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:33.443+0000 7f3e742ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:33.453 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:33.454 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:33.457 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:33.457 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:34.185 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:34.239 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 7906 7890 1.04466 1.04688 0.102637 0.119493 2024-04-25T09:41:34.333 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:34.337+0000 7f10234ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:34.338 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:34.344+0000 7f10234ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:35.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:41:35.246996+0000 min lat: 0.0162562 max lat: 0.39012 avg lat: 0.119689 2024-04-25T09:41:35.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:41:35.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 8025 8009 1.04275 0.929688 0.138573 0.119689 2024-04-25T09:41:36.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 8155 8139 1.0423 1.01562 0.105862 0.119753 2024-04-25T09:41:36.606 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:36.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:36.745+0000 7fa0b699d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:36.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:36.754+0000 7fa0b699d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:37.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 8284 8268 1.04174 1.00781 0.103733 0.119814 2024-04-25T09:41:38.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 8415 8399 1.04145 1.02344 0.0854023 0.119878 2024-04-25T09:41:38.459 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:38.459 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:38.459 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:38.459 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:38.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:38.618+0000 7eff26f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:38.626 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:38.632+0000 7eff26f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:38.703 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:38.704 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:38.707 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:38.708 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:38.708 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:38.845 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:38.845+0000 7f2249a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:38.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:38.857+0000 7f2249a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:38.879 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:38.880 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:38.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:38.883 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:38.883 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:38.943 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:39.011 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:39.009+0000 7fb73d22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:39.017 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:39.023+0000 7fb73d22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:39.035 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:39.035 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:39.035 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:39.035 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:39.035 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:39.035 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:39.036 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:39.036 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:39.036 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:39.036 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:39.036 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:39.036 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:39.038 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:39.039 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:39.039 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:39.104 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:39.107+0000 7fae5fd1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:39.111 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:39.117+0000 7fae5fd1d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:39.177 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:39.176+0000 7f8b2cd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:39.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:39.190+0000 7f8b2cd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:39.203 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:39.204 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:39.206 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:39.207 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:39.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 8536 8520 1.03995 0.945312 0.0758737 0.120088 2024-04-25T09:41:40.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 16 8660 8644 1.03885 0.96875 0.149296 0.120153 2024-04-25T09:41:41.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 8772 8756 1.03637 0.875 0.0662841 0.120447 2024-04-25T09:41:41.370 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:41.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:41.494+0000 7f45ef15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:41.494 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:41.501+0000 7f45ef15d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:42.240 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 8901 8885 1.03594 1.00781 0.0620243 0.12057 2024-04-25T09:41:43.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 9033 9017 1.03587 1.03125 0.0831268 0.120557 2024-04-25T09:41:43.722 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:43.839 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:43.843+0000 7fcfd959d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:43.843 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:43.849+0000 7fcfd959d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.208 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:44.208 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:44.208 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:44.208 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:44.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 9163 9147 1.03557 1.01562 0.210221 0.120561 2024-04-25T09:41:44.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.326+0000 7f387375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.335 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.341+0000 7f387375d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.359 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:44.359 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:44.359 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:44.360 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:44.360 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:44.360 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:44.360 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:44.360 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:44.360 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:44.361 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:44.361 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:44.361 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:44.363 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:44.364 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:44.364 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:44.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.535+0000 7f759f26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.545+0000 7f759f26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.564 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:44.564 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:44.564 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:44.565 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:44.565 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:44.565 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:44.565 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:44.565 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:44.565 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:44.566 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:44.566 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:44.566 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:44.568 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:44.570 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:44.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:44.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.694+0000 7f51170ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.698 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.704+0000 7f51170ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.719 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:44.719 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:44.719 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:44.719 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:44.719 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:44.719 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:44.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:44.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:44.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:44.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:44.720 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:44.720 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:44.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:44.722 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:44.722 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:44.846 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.846+0000 7fcfb5d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:44.856+0000 7fcfb5d9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:44.877 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:44.878 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:44.878 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:44.878 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:44.880 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:44.881 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:45.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 9286 9270 1.0345 0.960938 0.091551 0.120679 2024-04-25T09:41:46.075 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:46.221 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:46.225+0000 7f138159d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:46.225 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:46.231+0000 7f138159d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:46.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 9411 9395 1.03369 0.976562 0.112974 0.120739 2024-04-25T09:41:47.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 9522 9506 1.03137 0.867188 0.15319 0.121072 2024-04-25T09:41:48.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 16 9647 9631 1.03062 0.976562 0.0470986 0.121131 2024-04-25T09:41:48.433 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:48.547 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:48.551+0000 7f6b140ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:48.551 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:48.557+0000 7f6b140ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:49.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 9781 9765 1.03084 1.04688 0.0600563 0.121144 2024-04-25T09:41:49.882 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:49.882 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:49.882 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:49.882 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:50.016 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.015+0000 7f52c199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.021 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.026+0000 7f52c199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:50.079 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:50.080 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:50.080 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:50.080 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:50.082 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:50.083 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:50.083 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:50.214 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.213+0000 7f673026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.218 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.225+0000 7f673026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 16 9912 9896 1.03074 1.02344 0.211874 0.121135 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:50.274 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:50.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:50.277 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:50.278 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:50.411 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.411+0000 7f1e9495d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.415 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.422+0000 7f1e9495d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:50.431 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:50.432 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:50.432 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:50.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:50.434 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:50.434 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:50.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.559+0000 7f14d459d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.569+0000 7f14d459d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:50.679 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:50.680 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:50.683 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:50.684 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:50.696 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:50.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.831+0000 7f8d914ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:50.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:50.838+0000 7f8d914ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:51.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 10034 10018 1.02972 0.953125 0.158229 0.12125 2024-04-25T09:41:52.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 16 10164 10148 1.02953 1.01562 0.0609223 0.121263 2024-04-25T09:41:53.059 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:53.184 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:53.188+0000 7f4c9739d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:53.189 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:53.195+0000 7f4c9739d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:53.241 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 10289 10273 1.02885 0.976562 0.179385 0.12136 2024-04-25T09:41:54.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 10411 10395 1.02789 0.953125 0.203965 0.121427 2024-04-25T09:41:55.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-04-25T09:41:55.248884+0000 min lat: 0.0162562 max lat: 0.39012 avg lat: 0.121586 2024-04-25T09:41:55.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-25T09:41:55.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 15 10530 10515 1.02676 0.9375 0.028315 0.121586 2024-04-25T09:41:55.435 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:41:55.552 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:55.555+0000 7f1ac12ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:55.555 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:55.561+0000 7f1ac12ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:55.685 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:41:55.685 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:41:55.685 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:41:55.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:41:55.802 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:55.802+0000 7f4575d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:55.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:55.812+0000 7f4575d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:55.854 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:55.855 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:55.855 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:55.855 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:55.856 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:55.857 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:55.857 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:41:55.981 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:55.979+0000 7fbaa9ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:55.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:55.992+0000 7fbaa9ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:56.006 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:56.007 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:56.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:56.010 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:56.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:41:56.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:56.132+0000 7fe24119d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:56.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:56.143+0000 7fe24119d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:56.153 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:56.153 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:56.153 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:56.154 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:56.157 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:56.157 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:56.158 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:41:56.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 10641 10625 1.0247 0.859375 0.104339 0.121872 2024-04-25T09:41:56.284 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:56.282+0000 7eff824ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:56.289 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:56.295+0000 7eff824ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:41:56.310 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:41:56.311 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:41:56.312 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:41:56.313 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:41:57.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 16 10765 10749 1.02401 0.96875 0.0762313 0.121925 2024-04-25T09:41:57.694 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:41:57.816 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:57.820+0000 7fe33439d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:57.821 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:41:57.826+0000 7fe33439d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:41:58.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 16 10885 10869 1.02297 0.9375 0.0409883 0.122054 2024-04-25T09:41:59.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 11005 10989 1.02195 0.9375 0.189197 0.122194 2024-04-25T09:42:00.038 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:42:00.162 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:00.166+0000 7f12f259d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:00.167 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:00.172+0000 7f12f259d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:00.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 11129 11113 1.02132 0.96875 0.155578 0.122235 2024-04-25T09:42:01.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 11254 11238 1.0208 0.976562 0.16573 0.122338 2024-04-25T09:42:01.314 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:42:01.314 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:42:01.314 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:01.477 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:01.478+0000 7f44b2620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:01.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:01.488+0000 7f44b2620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:01.775 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:01.776 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:01.793 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":530,"stamp":"2024-04-25T09:42:01.409896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88367648,"num_objects":1343,"num_object_clones":0,"num_object_copies":4029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":10852,"num_write_kb":87614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10796,"ondisk_log_size":10796,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":601768,"kb_used_data":130760,"kb_used_omap":0,"kb_used_meta":470976,"kb_avail":376885592,"statfs":{"total":386547056640,"available":385930846208,"internally_reserved":0,"allocated":133898240,"data_stored":264657792,"data_compressed":13604382,"data_compressed_allocated":131018752,"data_compressed_original":263512064,"omap_allocated":0,"internal_metadata":482279424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10117120,"num_objects":155,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":9880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002776"},"pg_stats":[{"pgid":"10.7","version":"107'519","reported_seq":540,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:55.304226+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:41:55.304226+0000","last_peered":"2024-04-25T09:41:55.304226+0000","last_clean":"2024-04-25T09:41:55.304226+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:41:55.304226+0000","last_undegraded":"2024-04-25T09:41:55.304226+0000","last_fullsized":"2024-04-25T09:41:55.304226+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"107'607","reported_seq":628,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:54.601779+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:41:54.601779+0000","last_peered":"2024-04-25T09:41:54.601779+0000","last_clean":"2024-04-25T09:41:54.601779+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:41:54.601779+0000","last_undegraded":"2024-04-25T09:41:54.601779+0000","last_fullsized":"2024-04-25T09:41:54.601779+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"107'700","reported_seq":725,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:57.424540+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:41:57.424540+0000","last_peered":"2024-04-25T09:41:57.424540+0000","last_clean":"2024-04-25T09:41:57.424540+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:41:57.424540+0000","last_undegraded":"2024-04-25T09:41:57.424540+0000","last_fullsized":"2024-04-25T09:41:57.424540+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5742592,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":701,"num_write_kb":5608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"107'660","reported_seq":681,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:57.504875+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:41:57.504875+0000","last_peered":"2024-04-25T09:41:57.504875+0000","last_clean":"2024-04-25T09:41:57.504875+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:41:57.504875+0000","last_undegraded":"2024-04-25T09:41:57.504875+0000","last_fullsized":"2024-04-25T09:41:57.504875+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5414912,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":5288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"107'607","reported_seq":628,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:56.521872+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:41:56.521872+0000","last_peered":"2024-04-25T09:41:56.521872+0000","last_clean":"2024-04-25T09:41:56.521872+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:41:56.521872+0000","last_undegraded":"2024-04-25T09:41:56.521872+0000","last_fullsized":"2024-04-25T09:41:56.521872+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"107'751","reported_seq":772,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:57.227711+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:41:57.227711+0000","last_peered":"2024-04-25T09:41:57.227711+0000","last_clean":"2024-04-25T09:41:57.227711+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:41:57.227711+0000","last_undegraded":"2024-04-25T09:41:57.227711+0000","last_fullsized":"2024-04-25T09:41:57.227711+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"107'791","reported_seq":812,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:56.294543+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:41:56.294543+0000","last_peered":"2024-04-25T09:41:56.294543+0000","last_clean":"2024-04-25T09:41:56.294543+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:41:56.294543+0000","last_undegraded":"2024-04-25T09:41:56.294543+0000","last_fullsized":"2024-04-25T09:41:56.294543+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"107'766","reported_seq":787,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:56.494500+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:41:56.494500+0000","last_peered":"2024-04-25T09:41:56.494500+0000","last_clean":"2024-04-25T09:41:56.494500+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:41:56.494500+0000","last_undegraded":"2024-04-25T09:41:56.494500+0000","last_fullsized":"2024-04-25T09:41:56.494500+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6283264,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":767,"num_write_kb":6136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"107'729","reported_seq":750,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:56.483168+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:41:56.483168+0000","last_peered":"2024-04-25T09:41:56.483168+0000","last_clean":"2024-04-25T09:41:56.483168+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:41:56.483168+0000","last_undegraded":"2024-04-25T09:41:56.483168+0000","last_fullsized":"2024-04-25T09:41:56.483168+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5980160,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":5840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":381,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.633865+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:40.633865+0000","last_peered":"2024-04-25T09:40:40.633865+0000","last_clean":"2024-04-25T09:40:40.633865+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:40.633865+0000","last_undegraded":"2024-04-25T09:40:40.633865+0000","last_fullsized":"2024-04-25T09:40:40.633865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.637157+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:40.637157+0000","last_peered":"2024-04-25T09:40:40.637157+0000","last_clean":"2024-04-25T09:40:40.637157+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:40.637157+0000","last_undegraded":"2024-04-25T09:40:40.637157+0000","last_fullsized":"2024-04-25T09:40:40.637157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"107'775","reported_seq":800,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:57.401189+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:41:57.401189+0000","last_peered":"2024-04-25T09:41:57.401189+0000","last_clean":"2024-04-25T09:41:57.401189+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:41:57.401189+0000","last_undegraded":"2024-04-25T09:41:57.401189+0000","last_fullsized":"2024-04-25T09:41:57.401189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":775,"log_dups_size":0,"ondisk_log_size":775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:40.638658+0000","last_peered":"2024-04-25T09:40:40.638658+0000","last_clean":"2024-04-25T09:40:40.638658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:40.638658+0000","last_undegraded":"2024-04-25T09:40:40.638658+0000","last_fullsized":"2024-04-25T09:40:40.638658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"107'687","reported_seq":708,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:57.446765+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:41:57.446765+0000","last_peered":"2024-04-25T09:41:57.446765+0000","last_clean":"2024-04-25T09:41:57.446765+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:41:57.446765+0000","last_undegraded":"2024-04-25T09:41:57.446765+0000","last_fullsized":"2024-04-25T09:41:57.446765+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.613724+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:40.613724+0000","last_peered":"2024-04-25T09:40:40.613724+0000","last_clean":"2024-04-25T09:40:40.613724+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:40.613724+0000","last_undegraded":"2024-04-25T09:40:40.613724+0000","last_fullsized":"2024-04-25T09:40:40.613724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"107'743","reported_seq":764,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:55.112587+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:41:55.112587+0000","last_peered":"2024-04-25T09:41:55.112587+0000","last_clean":"2024-04-25T09:41:55.112587+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:41:55.112587+0000","last_undegraded":"2024-04-25T09:41:55.112587+0000","last_fullsized":"2024-04-25T09:41:55.112587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638667+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:40.638667+0000","last_peered":"2024-04-25T09:40:40.638667+0000","last_clean":"2024-04-25T09:40:40.638667+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:40.638667+0000","last_undegraded":"2024-04-25T09:40:40.638667+0000","last_fullsized":"2024-04-25T09:40:40.638667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"107'567","reported_seq":588,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:56.191103+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:41:56.191103+0000","last_peered":"2024-04-25T09:41:56.191103+0000","last_clean":"2024-04-25T09:41:56.191103+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:41:56.191103+0000","last_undegraded":"2024-04-25T09:41:56.191103+0000","last_fullsized":"2024-04-25T09:41:56.191103+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.444828+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:39.444828+0000","last_peered":"2024-04-25T09:40:39.444828+0000","last_clean":"2024-04-25T09:40:39.444828+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:39.444828+0000","last_undegraded":"2024-04-25T09:40:39.444828+0000","last_fullsized":"2024-04-25T09:40:39.444828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"107'583","reported_seq":604,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:54.398616+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:41:54.398616+0000","last_peered":"2024-04-25T09:41:54.398616+0000","last_clean":"2024-04-25T09:41:54.398616+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:41:54.398616+0000","last_undegraded":"2024-04-25T09:41:54.398616+0000","last_fullsized":"2024-04-25T09:41:54.398616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":248,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.655194+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:40.655194+0000","last_peered":"2024-04-25T09:40:40.655194+0000","last_clean":"2024-04-25T09:40:40.655194+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:40.655194+0000","last_undegraded":"2024-04-25T09:40:40.655194+0000","last_fullsized":"2024-04-25T09:40:40.655194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"107'615","reported_seq":636,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:53.782351+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:41:53.782351+0000","last_peered":"2024-04-25T09:41:53.782351+0000","last_clean":"2024-04-25T09:41:53.782351+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:41:53.782351+0000","last_undegraded":"2024-04-25T09:41:53.782351+0000","last_fullsized":"2024-04-25T09:41:53.782351+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.420187+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:39.420187+0000","last_peered":"2024-04-25T09:40:39.420187+0000","last_clean":"2024-04-25T09:40:39.420187+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:39.420187+0000","last_undegraded":"2024-04-25T09:40:39.420187+0000","last_fullsized":"2024-04-25T09:40:39.420187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"107'599","reported_seq":620,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:41:55.397784+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:41:55.397784+0000","last_peered":"2024-04-25T09:41:55.397784+0000","last_clean":"2024-04-25T09:41:55.397784+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:41:55.397784+0000","last_undegraded":"2024-04-25T09:41:55.397784+0000","last_fullsized":"2024-04-25T09:41:55.397784+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.623069+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:40.623069+0000","last_peered":"2024-04-25T09:40:40.623069+0000","last_clean":"2024-04-25T09:40:40.623069+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:40.623069+0000","last_undegraded":"2024-04-25T09:40:40.623069+0000","last_fullsized":"2024-04-25T09:40:40.623069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":87777280,"num_objects":1341,"num_object_clones":0,"num_object_copies":4023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10715,"num_write_kb":85720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131776512,"data_stored":263553024,"data_compressed":13605426,"data_compressed_allocated":131776512,"data_compressed_original":263553024,"omap_allocated":0,"internal_metadata":0},"log_size":10699,"ondisk_log_size":10699,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149984,"kb_used_data":24600,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94221856,"statfs":{"total":96636764160,"available":96483180544,"internally_reserved":0,"allocated":25190400,"data_stored":49713000,"data_compressed":2551738,"data_compressed_allocated":24465408,"data_compressed_original":49422336,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":145432,"kb_used_data":38096,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94226408,"statfs":{"total":96636764160,"available":96487841792,"internally_reserved":0,"allocated":39010304,"data_stored":77352808,"data_compressed":3978552,"data_compressed_allocated":38285312,"data_compressed_original":77062144,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154480,"kb_used_data":33256,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94217360,"statfs":{"total":96636764160,"available":96478576640,"internally_reserved":0,"allocated":34054144,"data_stored":66973000,"data_compressed":3443174,"data_compressed_allocated":33349632,"data_compressed_original":66699264,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151872,"kb_used_data":34808,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94219968,"statfs":{"total":96636764160,"available":96481247232,"internally_reserved":0,"allocated":35643392,"data_stored":70618984,"data_compressed":3630918,"data_compressed_allocated":34918400,"data_compressed_original":70328320,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35192832,"data_stored":70385664,"data_compressed":3633522,"data_compressed_allocated":35192832,"data_compressed_original":70385664,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33566720,"data_stored":67133440,"data_compressed":3465593,"data_compressed_allocated":33566720,"data_compressed_original":67133440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38285312,"data_stored":76570624,"data_compressed":3952815,"data_compressed_allocated":38285312,"data_compressed_original":76570624,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24731648,"data_stored":49463296,"data_compressed":2553496,"data_compressed_allocated":24731648,"data_compressed_original":49463296,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:02.242 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 11374 11358 1.01984 0.9375 0.0421045 0.122443 2024-04-25T09:42:02.349 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:42:02.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:02.503+0000 7f91195ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:02.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:02.509+0000 7f91195ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:03.243 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 16 11482 11466 1.01784 0.84375 0.0581614 0.122691 2024-04-25T09:42:04.243 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 11608 11592 1.01746 0.984375 0.205291 0.122737 2024-04-25T09:42:04.741 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:42:04.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:04.862+0000 7fe86c62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:04.863 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:04.869+0000 7fe86c62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:05.243 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 15 11721 11706 1.01605 0.890625 0.173421 0.12292 2024-04-25T09:42:06.243 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 90.1249 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 11721 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 8192 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 65536 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 1.01604 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 0.0790656 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 1.1875 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 0.84375 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 130 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 10.1204 2024-04-25T09:42:06.244 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 152 2024-04-25T09:42:06.245 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 108 2024-04-25T09:42:06.245 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.12293 2024-04-25T09:42:06.245 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.0597493 2024-04-25T09:42:06.245 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.406776 2024-04-25T09:42:06.245 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.0162562 2024-04-25T09:42:06.268 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Cleaning up (deleting benchmark objects) 2024-04-25T09:42:06.796 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:42:06.796 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:42:06.796 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:42:06.796 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:42:06.921 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:06.920+0000 7f20fba6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:06.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:06.932+0000 7f20fba6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:07.006 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:07.007 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:07.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:07.009 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:07.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:42:07.133 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.132+0000 7fa5b275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.143+0000 7fa5b275d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.163 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:07.163 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:07.163 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:07.163 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:07.163 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:07.164 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:07.164 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:07.164 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:07.164 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:07.164 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:07.164 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:07.164 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:07.166 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:07.166 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:07.167 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:42:07.181 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:42:07.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.300+0000 7fe7d859d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.316+0000 7fe7d859d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.340+0000 7f2da3817640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:07.339 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:07.340 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:07.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.347+0000 7f2da3817640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:07.343 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:07.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:42:07.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.474+0000 7fe99d82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:07.488+0000 7fe99d82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:07.599 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:07.599 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:07.599 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:07.599 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:07.599 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:07.599 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:07.600 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:07.600 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:07.600 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:07.600 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:07.600 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:07.600 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:07.602 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:07.603 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:09.634 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:42:09.756 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:09.760+0000 7f733f6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:09.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:09.767+0000 7f733f6ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:12.143 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:42:12.271 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:12.274+0000 7ff1df42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:12.276 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:12.281+0000 7ff1df42d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:12.604 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:42:12.604 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:42:12.604 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-25T09:42:12.605 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-25T09:42:12.736 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:12.735+0000 7f367e35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:12.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:12.746+0000 7f367e35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:12.848 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:12.849 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:12.850 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:12.851 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:12.851 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-25T09:42:12.984 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:12.983+0000 7fe69899d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:12.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:12.994+0000 7fe69899d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:13.031 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:13.031 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:13.031 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:13.031 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:13.031 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:13.031 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:13.032 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:13.032 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:13.032 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:13.032 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:13.032 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:13.032 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:13.035 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:13.035 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:13.036 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-25T09:42:13.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:13.169+0000 7f9bc4f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:13.174 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:13.179+0000 7f9bc4f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:13.196 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:13.197 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:13.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:13.199 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:13.199 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-04-25T09:42:13.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:13.323+0000 7f3f59a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:13.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:13.339+0000 7f3f59a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:13.440 INFO:teuthology.orchestra.run.smithi165.stderr:no valid command found; 10 closest matches: 2024-04-25T09:42:13.440 INFO:teuthology.orchestra.run.smithi165.stderr:config get 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:config help 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:config set ... 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:config show 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:deep_scrub 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_ops 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:dump_historic_slow_ops 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:dump_metrics [] 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:dump_ops_in_flight 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:dump_pgstate_history 2024-04-25T09:42:13.441 INFO:teuthology.orchestra.run.smithi165.stderr:Error EINVAL: invalid command 2024-04-25T09:42:13.444 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-25T09:42:13.445 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-25T09:42:14.507 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-25T09:42:14.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:14.637+0000 7f5f78c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:14.639 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:14.644+0000 7f5f78c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:16.682 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Removed 1466 objects 2024-04-25T09:42:16.682 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Clean up completed and total clean up time :10.4137 2024-04-25T09:42:17.183 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-25T09:42:17.295 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:17.299+0000 7fbb1026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:17.299 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:17.304+0000 7fbb1026d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:18.445 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-04-25T09:42:18.446 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-04-25T09:42:18.446 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:18.558 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:18.560+0000 7fad13f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:18.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:18.568+0000 7fad13f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:18.756 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:18.757 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:18.768 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2024-04-25T09:42:17.413232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14230072,"num_objects":212,"num_object_clones":0,"num_object_copies":636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":13116,"num_write_kb":95663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13060,"ondisk_log_size":13060,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":553452,"kb_used_data":39404,"kb_used_omap":0,"kb_used_meta":513984,"kb_avail":376933908,"statfs":{"total":386547056640,"available":385980321792,"internally_reserved":0,"allocated":40349696,"data_stored":77536200,"data_compressed":3945543,"data_compressed_allocated":37457920,"data_compressed_original":76390400,"omap_allocated":0,"internal_metadata":526319616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-78905320,"num_objects":-1203,"num_object_clones":0,"num_object_copies":-3609,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1682,"num_write_kb":3393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002225"},"pg_stats":[{"pgid":"10.7","version":"107'665","reported_seq":686,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.334915+0000","last_change":"2024-04-25T09:40:34.411919+0000","last_active":"2024-04-25T09:42:16.334915+0000","last_peered":"2024-04-25T09:42:16.334915+0000","last_clean":"2024-04-25T09:42:16.334915+0000","last_became_active":"2024-04-25T09:40:34.401810+0000","last_became_peered":"2024-04-25T09:40:34.401810+0000","last_unstale":"2024-04-25T09:42:16.334915+0000","last_undegraded":"2024-04-25T09:42:16.334915+0000","last_fullsized":"2024-04-25T09:42:16.334915+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"107'754","reported_seq":775,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.430325+0000","last_change":"2024-04-25T09:40:34.403384+0000","last_active":"2024-04-25T09:42:16.430325+0000","last_peered":"2024-04-25T09:42:16.430325+0000","last_clean":"2024-04-25T09:42:16.430325+0000","last_became_active":"2024-04-25T09:40:34.392459+0000","last_became_peered":"2024-04-25T09:40:34.392459+0000","last_unstale":"2024-04-25T09:42:16.430325+0000","last_undegraded":"2024-04-25T09:42:16.430325+0000","last_fullsized":"2024-04-25T09:42:16.430325+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.5","version":"107'805","reported_seq":830,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:12.285661+0000","last_change":"2024-04-25T09:40:34.360551+0000","last_active":"2024-04-25T09:42:12.285661+0000","last_peered":"2024-04-25T09:42:12.285661+0000","last_clean":"2024-04-25T09:42:12.285661+0000","last_became_active":"2024-04-25T09:40:34.353380+0000","last_became_peered":"2024-04-25T09:40:34.353380+0000","last_unstale":"2024-04-25T09:42:12.285661+0000","last_undegraded":"2024-04-25T09:42:12.285661+0000","last_fullsized":"2024-04-25T09:42:12.285661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.4","version":"107'794","reported_seq":815,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:12.221065+0000","last_change":"2024-04-25T09:40:34.358544+0000","last_active":"2024-04-25T09:42:12.221065+0000","last_peered":"2024-04-25T09:42:12.221065+0000","last_clean":"2024-04-25T09:42:12.221065+0000","last_became_active":"2024-04-25T09:40:34.351296+0000","last_became_peered":"2024-04-25T09:40:34.351296+0000","last_unstale":"2024-04-25T09:42:12.221065+0000","last_undegraded":"2024-04-25T09:42:12.221065+0000","last_fullsized":"2024-04-25T09:42:12.221065+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":795,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"107'754","reported_seq":775,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.349208+0000","last_change":"2024-04-25T09:40:34.467042+0000","last_active":"2024-04-25T09:42:16.349208+0000","last_peered":"2024-04-25T09:42:16.349208+0000","last_clean":"2024-04-25T09:42:16.349208+0000","last_became_active":"2024-04-25T09:40:34.457323+0000","last_became_peered":"2024-04-25T09:40:34.457323+0000","last_unstale":"2024-04-25T09:42:16.349208+0000","last_undegraded":"2024-04-25T09:42:16.349208+0000","last_fullsized":"2024-04-25T09:42:16.349208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2","version":"107'846","reported_seq":867,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:12.422736+0000","last_change":"2024-04-25T09:40:34.328933+0000","last_active":"2024-04-25T09:42:12.422736+0000","last_peered":"2024-04-25T09:42:12.422736+0000","last_clean":"2024-04-25T09:42:12.422736+0000","last_became_active":"2024-04-25T09:40:34.316378+0000","last_became_peered":"2024-04-25T09:40:34.316378+0000","last_unstale":"2024-04-25T09:42:12.422736+0000","last_undegraded":"2024-04-25T09:42:12.422736+0000","last_fullsized":"2024-04-25T09:42:12.422736+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":847,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"107'952","reported_seq":973,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.388978+0000","last_change":"2024-04-25T09:40:34.369618+0000","last_active":"2024-04-25T09:42:16.388978+0000","last_peered":"2024-04-25T09:42:16.388978+0000","last_clean":"2024-04-25T09:42:16.388978+0000","last_became_active":"2024-04-25T09:40:34.359849+0000","last_became_peered":"2024-04-25T09:40:34.359849+0000","last_unstale":"2024-04-25T09:42:16.388978+0000","last_undegraded":"2024-04-25T09:42:16.388978+0000","last_fullsized":"2024-04-25T09:42:16.388978+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":953,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"107'944","reported_seq":965,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.488210+0000","last_change":"2024-04-25T09:40:34.428532+0000","last_active":"2024-04-25T09:42:16.488210+0000","last_peered":"2024-04-25T09:42:16.488210+0000","last_clean":"2024-04-25T09:42:16.488210+0000","last_became_active":"2024-04-25T09:40:34.411748+0000","last_became_peered":"2024-04-25T09:40:34.411748+0000","last_unstale":"2024-04-25T09:42:16.488210+0000","last_undegraded":"2024-04-25T09:42:16.488210+0000","last_fullsized":"2024-04-25T09:42:16.488210+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":945,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"107'890","reported_seq":911,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:15.968172+0000","last_change":"2024-04-25T09:40:34.297087+0000","last_active":"2024-04-25T09:42:15.968172+0000","last_peered":"2024-04-25T09:42:15.968172+0000","last_clean":"2024-04-25T09:42:15.968172+0000","last_became_active":"2024-04-25T09:40:34.289186+0000","last_became_peered":"2024-04-25T09:40:34.289186+0000","last_unstale":"2024-04-25T09:42:15.968172+0000","last_undegraded":"2024-04-25T09:42:15.968172+0000","last_fullsized":"2024-04-25T09:42:15.968172+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":891,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'97","reported_seq":381,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.633865+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:40:40.633865+0000","last_peered":"2024-04-25T09:40:40.633865+0000","last_clean":"2024-04-25T09:40:40.633865+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:40:40.633865+0000","last_undegraded":"2024-04-25T09:40:40.633865+0000","last_fullsized":"2024-04-25T09:40:40.633865+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.637157+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:40:40.637157+0000","last_peered":"2024-04-25T09:40:40.637157+0000","last_clean":"2024-04-25T09:40:40.637157+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:40:40.637157+0000","last_undegraded":"2024-04-25T09:40:40.637157+0000","last_fullsized":"2024-04-25T09:40:40.637157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.8","version":"107'886","reported_seq":911,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:12.327005+0000","last_change":"2024-04-25T09:40:34.324139+0000","last_active":"2024-04-25T09:42:12.327005+0000","last_peered":"2024-04-25T09:42:12.327005+0000","last_clean":"2024-04-25T09:42:12.327005+0000","last_became_active":"2024-04-25T09:40:34.319069+0000","last_became_peered":"2024-04-25T09:40:34.319069+0000","last_unstale":"2024-04-25T09:42:12.327005+0000","last_undegraded":"2024-04-25T09:42:12.327005+0000","last_fullsized":"2024-04-25T09:42:12.327005+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":886,"log_dups_size":0,"ondisk_log_size":886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638658+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:40:40.638658+0000","last_peered":"2024-04-25T09:40:40.638658+0000","last_clean":"2024-04-25T09:40:40.638658+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:40:40.638658+0000","last_undegraded":"2024-04-25T09:40:40.638658+0000","last_fullsized":"2024-04-25T09:40:40.638658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"107'820","reported_seq":841,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:12.378360+0000","last_change":"2024-04-25T09:40:34.381212+0000","last_active":"2024-04-25T09:42:12.378360+0000","last_peered":"2024-04-25T09:42:12.378360+0000","last_clean":"2024-04-25T09:42:12.378360+0000","last_became_active":"2024-04-25T09:40:34.373288+0000","last_became_peered":"2024-04-25T09:40:34.373288+0000","last_unstale":"2024-04-25T09:42:12.378360+0000","last_undegraded":"2024-04-25T09:42:12.378360+0000","last_fullsized":"2024-04-25T09:42:12.378360+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":821,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.613724+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:40:40.613724+0000","last_peered":"2024-04-25T09:40:40.613724+0000","last_clean":"2024-04-25T09:40:40.613724+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:40:40.613724+0000","last_undegraded":"2024-04-25T09:40:40.613724+0000","last_fullsized":"2024-04-25T09:40:40.613724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"107'907","reported_seq":928,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.114165+0000","last_change":"2024-04-25T09:40:34.428720+0000","last_active":"2024-04-25T09:42:16.114165+0000","last_peered":"2024-04-25T09:42:16.114165+0000","last_clean":"2024-04-25T09:42:16.114165+0000","last_became_active":"2024-04-25T09:40:34.417564+0000","last_became_peered":"2024-04-25T09:40:34.417564+0000","last_unstale":"2024-04-25T09:42:16.114165+0000","last_undegraded":"2024-04-25T09:42:16.114165+0000","last_fullsized":"2024-04-25T09:42:16.114165+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":908,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":246,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.638667+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:40:40.638667+0000","last_peered":"2024-04-25T09:40:40.638667+0000","last_clean":"2024-04-25T09:40:40.638667+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:40:40.638667+0000","last_undegraded":"2024-04-25T09:40:40.638667+0000","last_fullsized":"2024-04-25T09:40:40.638667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"107'718","reported_seq":739,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.457551+0000","last_change":"2024-04-25T09:40:34.382676+0000","last_active":"2024-04-25T09:42:16.457551+0000","last_peered":"2024-04-25T09:42:16.457551+0000","last_clean":"2024-04-25T09:42:16.457551+0000","last_became_active":"2024-04-25T09:40:34.366449+0000","last_became_peered":"2024-04-25T09:40:34.366449+0000","last_unstale":"2024-04-25T09:42:16.457551+0000","last_undegraded":"2024-04-25T09:42:16.457551+0000","last_fullsized":"2024-04-25T09:42:16.457551+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.444828+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:40:39.444828+0000","last_peered":"2024-04-25T09:40:39.444828+0000","last_clean":"2024-04-25T09:40:39.444828+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:40:39.444828+0000","last_undegraded":"2024-04-25T09:40:39.444828+0000","last_fullsized":"2024-04-25T09:40:39.444828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"107'711","reported_seq":733,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.376462+0000","last_change":"2024-04-25T09:40:34.453925+0000","last_active":"2024-04-25T09:42:16.376462+0000","last_peered":"2024-04-25T09:42:16.376462+0000","last_clean":"2024-04-25T09:42:16.376462+0000","last_became_active":"2024-04-25T09:40:34.444955+0000","last_became_peered":"2024-04-25T09:40:34.444955+0000","last_unstale":"2024-04-25T09:42:16.376462+0000","last_undegraded":"2024-04-25T09:42:16.376462+0000","last_fullsized":"2024-04-25T09:42:16.376462+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73752,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":712,"num_write_kb":5065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":248,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.655194+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:40:40.655194+0000","last_peered":"2024-04-25T09:40:40.655194+0000","last_clean":"2024-04-25T09:40:40.655194+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:40:40.655194+0000","last_undegraded":"2024-04-25T09:40:40.655194+0000","last_fullsized":"2024-04-25T09:40:40.655194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"107'772","reported_seq":793,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.444147+0000","last_change":"2024-04-25T09:40:34.569649+0000","last_active":"2024-04-25T09:42:16.444147+0000","last_peered":"2024-04-25T09:42:16.444147+0000","last_clean":"2024-04-25T09:42:16.444147+0000","last_became_active":"2024-04-25T09:40:34.565110+0000","last_became_peered":"2024-04-25T09:40:34.565110+0000","last_unstale":"2024-04-25T09:42:16.444147+0000","last_undegraded":"2024-04-25T09:42:16.444147+0000","last_fullsized":"2024-04-25T09:42:16.444147+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":250,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:39.420187+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:40:39.420187+0000","last_peered":"2024-04-25T09:40:39.420187+0000","last_clean":"2024-04-25T09:40:39.420187+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:40:39.420187+0000","last_undegraded":"2024-04-25T09:40:39.420187+0000","last_fullsized":"2024-04-25T09:40:39.420187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.f","version":"107'745","reported_seq":766,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:42:16.398796+0000","last_change":"2024-04-25T09:40:34.454384+0000","last_active":"2024-04-25T09:42:16.398796+0000","last_peered":"2024-04-25T09:42:16.398796+0000","last_clean":"2024-04-25T09:42:16.398796+0000","last_became_active":"2024-04-25T09:40:34.444970+0000","last_became_peered":"2024-04-25T09:40:34.444970+0000","last_unstale":"2024-04-25T09:42:16.398796+0000","last_undegraded":"2024-04-25T09:42:16.398796+0000","last_fullsized":"2024-04-25T09:42:16.398796+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:40:33.148925+0000","last_clean_scrub_stamp":"2024-04-25T09:40:33.148925+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":244,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:40:40.623069+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:40:40.623069+0000","last_peered":"2024-04-25T09:40:40.623069+0000","last_clean":"2024-04-25T09:40:40.623069+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:40:40.623069+0000","last_undegraded":"2024-04-25T09:40:40.623069+0000","last_fullsized":"2024-04-25T09:40:40.623069+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":13639704,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12979,"num_write_kb":93769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28827648,"data_stored":57630792,"data_compressed":2975804,"data_compressed_allocated":28815360,"data_compressed_original":57630720,"omap_allocated":0,"internal_metadata":0},"log_size":12963,"ondisk_log_size":12963,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673828,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143188,"kb_used_data":13644,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94228652,"statfs":{"total":96636764160,"available":96490139648,"internally_reserved":0,"allocated":13971456,"data_stored":27275112,"data_compressed":1393718,"data_compressed_allocated":13246464,"data_compressed_original":26984448,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":147356,"kb_used_data":17812,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94224484,"statfs":{"total":96636764160,"available":96485871616,"internally_reserved":0,"allocated":18239488,"data_stored":35803008,"data_compressed":1834062,"data_compressed_allocated":17510400,"data_compressed_original":35512320,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133568,"kb_used_data":4024,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94238272,"statfs":{"total":96636764160,"available":96499990528,"internally_reserved":0,"allocated":4120576,"data_stored":7097696,"data_compressed":352358,"data_compressed_allocated":3411968,"data_compressed_original":6823936,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129340,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94242500,"statfs":{"total":96636764160,"available":96504320000,"internally_reserved":0,"allocated":4018176,"data_stored":7360384,"data_compressed":365405,"data_compressed_allocated":3289088,"data_compressed_original":7069696,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":729112,"data_compressed":37647,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":794648,"data_compressed":41031,"data_compressed_allocated":397312,"data_compressed_original":794624,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":34152472,"data_compressed":1763487,"data_compressed_allocated":17076224,"data_compressed_original":34152448,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10977280,"data_stored":21954560,"data_compressed":1133639,"data_compressed_allocated":10977280,"data_compressed_original":21954560,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:18.896 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_7 2024-04-25T09:42:18.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2024-04-25T09:42:19.008 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:19.005+0000 7fb02c19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:19.012 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:19.017+0000 7fb02c19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:19.361 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'unique_pool_7' removed 2024-04-25T09:42:19.375 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-25T09:42:19.389 INFO:tasks.thrashosds:joining thrashosds 2024-04-25T09:42:23.770 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-25T09:42:23.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:23.891+0000 7fbd7d62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:23.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:23.897+0000 7fbd7d62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:23.906 INFO:teuthology.orchestra.run.smithi165.stdout:{} 2024-04-25T09:42:23.906 INFO:teuthology.orchestra.run.smithi165.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-25T09:42:23.917 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-25T09:42:24.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:24.025+0000 7f0ed2aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:24.030 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:24.035+0000 7f0ed2aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:24.483 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.0 to 1 (10000) 2024-04-25T09:42:24.497 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-25T09:42:24.606 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:24.605+0000 7ff0728ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:24.610 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:24.615+0000 7ff0728ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:25.492 INFO:teuthology.orchestra.run.smithi165.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-25T09:42:25.507 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-25T09:42:25.618 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:25.618+0000 7fe65231d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:25.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:25.627+0000 7fe65231d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:26.502 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.1 to 1 (10000) 2024-04-25T09:42:26.517 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-25T09:42:26.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:26.649+0000 7fd46c424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:26.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:26.663+0000 7fd46c424640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:27.509 INFO:teuthology.orchestra.run.smithi165.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-25T09:42:27.523 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-25T09:42:27.634 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:27.633+0000 7f7278a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:27.638 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:27.643+0000 7f7278a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:28.514 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.2 to 1 (10000) 2024-04-25T09:42:28.531 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-25T09:42:28.671 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:28.670+0000 7fc3c80ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:28.674 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:28.680+0000 7fc3c80ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:29.520 INFO:teuthology.orchestra.run.smithi165.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-25T09:42:29.537 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-25T09:42:29.654 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:29.653+0000 7f666f417640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:29.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:29.662+0000 7f666f417640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:30.526 INFO:teuthology.orchestra.run.smithi165.stderr:reweighted osd.3 to 1 (10000) 2024-04-25T09:42:30.540 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-25T09:42:30.649 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:30.648+0000 7f2aa9817640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:30.653 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:30.658+0000 7f2aa9817640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:31.532 INFO:teuthology.orchestra.run.smithi165.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-25T09:42:31.551 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-25T09:42:31.551 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T09:42:31.551 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:42:31.664 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:31.665+0000 7f2c3779d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:31.667 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:31.672+0000 7f2c3779d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:31.856 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:31.856 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":117,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:42:31.535275+0000","last_up_change":"2024-04-25T09:27:42.387533+0000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:27:43.240966+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:27:44.537853+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1904214635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1904214635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1904214635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":1904214635}]},"public_addr":"172.21.15.165:6805/1904214635","cluster_addr":"172.21.15.165:6804/1904214635","heartbeat_back_addr":"172.21.15.165:6812/1904214635","heartbeat_front_addr":"172.21.15.165:6813/1904214635","state":["exists","up"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3016225021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":3016225021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":3016225021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3016225021}]},"public_addr":"172.21.15.165:6802/3016225021","cluster_addr":"172.21.15.165:6801/3016225021","heartbeat_back_addr":"172.21.15.165:6817/3016225021","heartbeat_front_addr":"172.21.15.165:6816/3016225021","state":["exists","up"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":2001234603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2001234603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2001234603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2001234603}]},"public_addr":"172.21.15.172:6805/2001234603","cluster_addr":"172.21.15.172:6804/2001234603","heartbeat_back_addr":"172.21.15.172:6812/2001234603","heartbeat_front_addr":"172.21.15.172:6809/2001234603","state":["exists","up"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":768266283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":768266283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":768266283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":768266283}]},"public_addr":"172.21.15.172:6811/768266283","cluster_addr":"172.21.15.172:6810/768266283","heartbeat_back_addr":"172.21.15.172:6807/768266283","heartbeat_front_addr":"172.21.15.172:6808/768266283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:42:31.870 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T09:42:31.870 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:42:31.979 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:31.980+0000 7fbbdb0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:31.982 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:31.987+0000 7fbbdb0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.173 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:32.174 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":117,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:42:31.535275+0000","last_up_change":"2024-04-25T09:27:42.387533+0000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:27:43.240966+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:27:44.537853+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1904214635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1904214635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1904214635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":1904214635}]},"public_addr":"172.21.15.165:6805/1904214635","cluster_addr":"172.21.15.165:6804/1904214635","heartbeat_back_addr":"172.21.15.165:6812/1904214635","heartbeat_front_addr":"172.21.15.165:6813/1904214635","state":["exists","up"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3016225021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":3016225021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":3016225021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3016225021}]},"public_addr":"172.21.15.165:6802/3016225021","cluster_addr":"172.21.15.165:6801/3016225021","heartbeat_back_addr":"172.21.15.165:6817/3016225021","heartbeat_front_addr":"172.21.15.165:6816/3016225021","state":["exists","up"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":2001234603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2001234603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2001234603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2001234603}]},"public_addr":"172.21.15.172:6805/2001234603","cluster_addr":"172.21.15.172:6804/2001234603","heartbeat_back_addr":"172.21.15.172:6812/2001234603","heartbeat_front_addr":"172.21.15.172:6809/2001234603","state":["exists","up"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":768266283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":768266283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":768266283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":768266283}]},"public_addr":"172.21.15.172:6811/768266283","cluster_addr":"172.21.15.172:6810/768266283","heartbeat_back_addr":"172.21.15.172:6807/768266283","heartbeat_front_addr":"172.21.15.172:6808/768266283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:42:32.187 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T09:42:32.188 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T09:42:32.188 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T09:42:32.188 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T09:42:32.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.305+0000 7f52a28ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.305+0000 7fd724954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.315+0000 7fd724954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.310 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.315+0000 7f52a28ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.331+0000 7f96dfe2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.328+0000 7f0e3bc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.336 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.342+0000 7f96dfe2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.337 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.342+0000 7f0e3bc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.349 INFO:teuthology.orchestra.run.smithi165.stdout:42949673848 2024-04-25T09:42:32.350 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:42:32.351 INFO:teuthology.orchestra.run.smithi165.stdout:38654706553 2024-04-25T09:42:32.351 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:42:32.369 INFO:teuthology.orchestra.run.smithi165.stdout:38654706553 2024-04-25T09:42:32.369 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:42:32.371 INFO:teuthology.orchestra.run.smithi165.stdout:42949673848 2024-04-25T09:42:32.371 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:42:32.469 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.469+0000 7f7f51c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.470 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.469+0000 7fea02e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.479+0000 7fea02e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.474 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.479+0000 7f7f51c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.529 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.529+0000 7f0691e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.533+0000 7fccd35cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.535 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.539+0000 7f0691e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.539 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:32.545+0000 7fccd35cf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:32.692 INFO:teuthology.orchestra.run.smithi165.stdout:42949673844 2024-04-25T09:42:32.694 INFO:teuthology.orchestra.run.smithi165.stdout:38654706547 2024-04-25T09:42:32.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706553 got 38654706547 for osd.0 2024-04-25T09:42:32.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673848 got 42949673844 for osd.2 2024-04-25T09:42:32.741 INFO:teuthology.orchestra.run.smithi165.stdout:38654706547 2024-04-25T09:42:32.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706553 got 38654706547 for osd.1 2024-04-25T09:42:32.757 INFO:teuthology.orchestra.run.smithi165.stdout:42949673843 2024-04-25T09:42:32.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673848 got 42949673843 for osd.3 2024-04-25T09:42:33.709 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:42:33.711 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:42:33.755 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:42:33.771 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:42:33.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.829+0000 7f345286d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:33.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.830+0000 7f409582d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:33.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.840+0000 7f345286d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:33.835 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.840+0000 7f409582d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:33.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.885+0000 7f6d1c55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:33.892 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.897+0000 7f6d1c55d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:33.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.941+0000 7f066646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:33.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:33.950+0000 7f066646d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:34.104 INFO:teuthology.orchestra.run.smithi165.stdout:38654706553 2024-04-25T09:42:34.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706553 got 38654706553 for osd.0 2024-04-25T09:42:34.118 INFO:teuthology.orchestra.run.smithi165.stdout:42949673849 2024-04-25T09:42:34.119 DEBUG:teuthology.parallel:result is None 2024-04-25T09:42:34.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673848 got 42949673849 for osd.2 2024-04-25T09:42:34.132 DEBUG:teuthology.parallel:result is None 2024-04-25T09:42:34.143 INFO:teuthology.orchestra.run.smithi165.stdout:38654706553 2024-04-25T09:42:34.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706553 got 38654706553 for osd.1 2024-04-25T09:42:34.157 DEBUG:teuthology.parallel:result is None 2024-04-25T09:42:34.181 INFO:teuthology.orchestra.run.smithi165.stdout:42949673848 2024-04-25T09:42:34.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673848 got 42949673848 for osd.3 2024-04-25T09:42:34.195 DEBUG:teuthology.parallel:result is None 2024-04-25T09:42:34.195 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-25T09:42:34.195 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:34.342 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:34.343+0000 7f6089f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:34.345 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:34.350+0000 7f6089f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:34.538 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:34.538 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:34.554 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":556,"stamp":"2024-04-25T09:42:33.416981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491380,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":489024,"kb_avail":376995980,"statfs":{"total":386547056640,"available":386043883520,"internally_reserved":0,"allocated":2207744,"data_stored":2523736,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":500760576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.896341"},"pg_stats":[{"pgid":"1.0","version":"13'97","reported_seq":400,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.556064+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:42:28.556064+0000","last_peered":"2024-04-25T09:42:28.556064+0000","last_clean":"2024-04-25T09:42:28.556064+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:42:28.556064+0000","last_undegraded":"2024-04-25T09:42:28.556064+0000","last_fullsized":"2024-04-25T09:42:28.556064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.580829+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:42:31.580829+0000","last_peered":"2024-04-25T09:42:31.580829+0000","last_clean":"2024-04-25T09:42:31.580829+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:42:31.580829+0000","last_undegraded":"2024-04-25T09:42:31.580829+0000","last_fullsized":"2024-04-25T09:42:31.580829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.650612+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:42:28.650612+0000","last_peered":"2024-04-25T09:42:28.650612+0000","last_clean":"2024-04-25T09:42:28.650612+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:42:28.650612+0000","last_undegraded":"2024-04-25T09:42:28.650612+0000","last_fullsized":"2024-04-25T09:42:28.650612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.555002+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:42:31.555002+0000","last_peered":"2024-04-25T09:42:31.555002+0000","last_clean":"2024-04-25T09:42:31.555002+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:42:31.555002+0000","last_undegraded":"2024-04-25T09:42:31.555002+0000","last_fullsized":"2024-04-25T09:42:31.555002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.655330+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:42:28.655330+0000","last_peered":"2024-04-25T09:42:28.655330+0000","last_clean":"2024-04-25T09:42:28.655330+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:42:28.655330+0000","last_undegraded":"2024-04-25T09:42:28.655330+0000","last_fullsized":"2024-04-25T09:42:28.655330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.568878+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:42:30.568878+0000","last_peered":"2024-04-25T09:42:30.568878+0000","last_clean":"2024-04-25T09:42:30.568878+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:42:30.568878+0000","last_undegraded":"2024-04-25T09:42:30.568878+0000","last_fullsized":"2024-04-25T09:42:30.568878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":267,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.571310+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:42:28.571310+0000","last_peered":"2024-04-25T09:42:28.571310+0000","last_clean":"2024-04-25T09:42:28.571310+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:42:28.571310+0000","last_undegraded":"2024-04-25T09:42:28.571310+0000","last_fullsized":"2024-04-25T09:42:28.571310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.563345+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:42:30.563345+0000","last_peered":"2024-04-25T09:42:30.563345+0000","last_clean":"2024-04-25T09:42:30.563345+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:42:30.563345+0000","last_undegraded":"2024-04-25T09:42:30.563345+0000","last_fullsized":"2024-04-25T09:42:30.563345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.578372+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:42:31.578372+0000","last_peered":"2024-04-25T09:42:31.578372+0000","last_clean":"2024-04-25T09:42:31.578372+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:42:31.578372+0000","last_undegraded":"2024-04-25T09:42:31.578372+0000","last_fullsized":"2024-04-25T09:42:31.578372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117608,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254232,"statfs":{"total":96636764160,"available":96516333568,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117624,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254216,"statfs":{"total":96636764160,"available":96516317184,"internally_reserved":0,"allocated":573440,"data_stored":780698,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130052,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241788,"statfs":{"total":96636764160,"available":96503590912,"internally_reserved":0,"allocated":520192,"data_stored":193226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126096,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245744,"statfs":{"total":96636764160,"available":96507641856,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:34.555 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:34.676 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:34.678+0000 7f535395d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:34.680 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:34.685+0000 7f535395d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:34.868 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:34.869 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:34.881 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":556,"stamp":"2024-04-25T09:42:33.416981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491380,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":489024,"kb_avail":376995980,"statfs":{"total":386547056640,"available":386043883520,"internally_reserved":0,"allocated":2207744,"data_stored":2523736,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":500760576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.896341"},"pg_stats":[{"pgid":"1.0","version":"13'97","reported_seq":400,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.556064+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:42:28.556064+0000","last_peered":"2024-04-25T09:42:28.556064+0000","last_clean":"2024-04-25T09:42:28.556064+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:42:28.556064+0000","last_undegraded":"2024-04-25T09:42:28.556064+0000","last_fullsized":"2024-04-25T09:42:28.556064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.580829+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:42:31.580829+0000","last_peered":"2024-04-25T09:42:31.580829+0000","last_clean":"2024-04-25T09:42:31.580829+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:42:31.580829+0000","last_undegraded":"2024-04-25T09:42:31.580829+0000","last_fullsized":"2024-04-25T09:42:31.580829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.650612+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:42:28.650612+0000","last_peered":"2024-04-25T09:42:28.650612+0000","last_clean":"2024-04-25T09:42:28.650612+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:42:28.650612+0000","last_undegraded":"2024-04-25T09:42:28.650612+0000","last_fullsized":"2024-04-25T09:42:28.650612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.555002+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:42:31.555002+0000","last_peered":"2024-04-25T09:42:31.555002+0000","last_clean":"2024-04-25T09:42:31.555002+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:42:31.555002+0000","last_undegraded":"2024-04-25T09:42:31.555002+0000","last_fullsized":"2024-04-25T09:42:31.555002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.655330+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:42:28.655330+0000","last_peered":"2024-04-25T09:42:28.655330+0000","last_clean":"2024-04-25T09:42:28.655330+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:42:28.655330+0000","last_undegraded":"2024-04-25T09:42:28.655330+0000","last_fullsized":"2024-04-25T09:42:28.655330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.568878+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:42:30.568878+0000","last_peered":"2024-04-25T09:42:30.568878+0000","last_clean":"2024-04-25T09:42:30.568878+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:42:30.568878+0000","last_undegraded":"2024-04-25T09:42:30.568878+0000","last_fullsized":"2024-04-25T09:42:30.568878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":267,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.571310+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:42:28.571310+0000","last_peered":"2024-04-25T09:42:28.571310+0000","last_clean":"2024-04-25T09:42:28.571310+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:42:28.571310+0000","last_undegraded":"2024-04-25T09:42:28.571310+0000","last_fullsized":"2024-04-25T09:42:28.571310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.563345+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:42:30.563345+0000","last_peered":"2024-04-25T09:42:30.563345+0000","last_clean":"2024-04-25T09:42:30.563345+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:42:30.563345+0000","last_undegraded":"2024-04-25T09:42:30.563345+0000","last_fullsized":"2024-04-25T09:42:30.563345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.578372+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:42:31.578372+0000","last_peered":"2024-04-25T09:42:31.578372+0000","last_clean":"2024-04-25T09:42:31.578372+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:42:31.578372+0000","last_undegraded":"2024-04-25T09:42:31.578372+0000","last_fullsized":"2024-04-25T09:42:31.578372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117608,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254232,"statfs":{"total":96636764160,"available":96516333568,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117624,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254216,"statfs":{"total":96636764160,"available":96516317184,"internally_reserved":0,"allocated":573440,"data_stored":780698,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130052,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241788,"statfs":{"total":96636764160,"available":96503590912,"internally_reserved":0,"allocated":520192,"data_stored":193226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126096,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245744,"statfs":{"total":96636764160,"available":96507641856,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:34.882 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-25T09:42:34.882 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-25T09:42:34.990 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:34.989+0000 7f19616ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:34.994 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:34.999+0000 7f19616ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:35.198 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T09:42:35.208 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:42:35.208 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:35.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:35.317+0000 7f48b542d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:35.320 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:35.325+0000 7f48b542d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:35.506 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:35.507 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:35.520 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-04-25T09:42:35.417569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491380,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":489024,"kb_avail":376995980,"statfs":{"total":386547056640,"available":386043883520,"internally_reserved":0,"allocated":2207744,"data_stored":2523736,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":500760576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"13'97","reported_seq":400,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.556064+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:42:28.556064+0000","last_peered":"2024-04-25T09:42:28.556064+0000","last_clean":"2024-04-25T09:42:28.556064+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:42:28.556064+0000","last_undegraded":"2024-04-25T09:42:28.556064+0000","last_fullsized":"2024-04-25T09:42:28.556064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.580829+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:42:31.580829+0000","last_peered":"2024-04-25T09:42:31.580829+0000","last_clean":"2024-04-25T09:42:31.580829+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:42:31.580829+0000","last_undegraded":"2024-04-25T09:42:31.580829+0000","last_fullsized":"2024-04-25T09:42:31.580829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.650612+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:42:28.650612+0000","last_peered":"2024-04-25T09:42:28.650612+0000","last_clean":"2024-04-25T09:42:28.650612+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:42:28.650612+0000","last_undegraded":"2024-04-25T09:42:28.650612+0000","last_fullsized":"2024-04-25T09:42:28.650612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.555002+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:42:31.555002+0000","last_peered":"2024-04-25T09:42:31.555002+0000","last_clean":"2024-04-25T09:42:31.555002+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:42:31.555002+0000","last_undegraded":"2024-04-25T09:42:31.555002+0000","last_fullsized":"2024-04-25T09:42:31.555002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.655330+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:42:28.655330+0000","last_peered":"2024-04-25T09:42:28.655330+0000","last_clean":"2024-04-25T09:42:28.655330+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:42:28.655330+0000","last_undegraded":"2024-04-25T09:42:28.655330+0000","last_fullsized":"2024-04-25T09:42:28.655330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.568878+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:42:30.568878+0000","last_peered":"2024-04-25T09:42:30.568878+0000","last_clean":"2024-04-25T09:42:30.568878+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:42:30.568878+0000","last_undegraded":"2024-04-25T09:42:30.568878+0000","last_fullsized":"2024-04-25T09:42:30.568878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":267,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.571310+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:42:28.571310+0000","last_peered":"2024-04-25T09:42:28.571310+0000","last_clean":"2024-04-25T09:42:28.571310+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:42:28.571310+0000","last_undegraded":"2024-04-25T09:42:28.571310+0000","last_fullsized":"2024-04-25T09:42:28.571310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.563345+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:42:30.563345+0000","last_peered":"2024-04-25T09:42:30.563345+0000","last_clean":"2024-04-25T09:42:30.563345+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:42:30.563345+0000","last_undegraded":"2024-04-25T09:42:30.563345+0000","last_fullsized":"2024-04-25T09:42:30.563345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.578372+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:42:31.578372+0000","last_peered":"2024-04-25T09:42:31.578372+0000","last_clean":"2024-04-25T09:42:31.578372+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:42:31.578372+0000","last_undegraded":"2024-04-25T09:42:31.578372+0000","last_fullsized":"2024-04-25T09:42:31.578372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117608,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254232,"statfs":{"total":96636764160,"available":96516333568,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117624,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254216,"statfs":{"total":96636764160,"available":96516317184,"internally_reserved":0,"allocated":573440,"data_stored":780698,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130052,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241788,"statfs":{"total":96636764160,"available":96503590912,"internally_reserved":0,"allocated":520192,"data_stored":193226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126096,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245744,"statfs":{"total":96636764160,"available":96507641856,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:35.521 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:35.629+0000 7fc3be0ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:35.632 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:35.637+0000 7fc3be0ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:35.821 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:35.821 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:35.834 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-04-25T09:42:35.417569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491380,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":489024,"kb_avail":376995980,"statfs":{"total":386547056640,"available":386043883520,"internally_reserved":0,"allocated":2207744,"data_stored":2523736,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":500760576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"13'97","reported_seq":400,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.556064+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:42:28.556064+0000","last_peered":"2024-04-25T09:42:28.556064+0000","last_clean":"2024-04-25T09:42:28.556064+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:42:28.556064+0000","last_undegraded":"2024-04-25T09:42:28.556064+0000","last_fullsized":"2024-04-25T09:42:28.556064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.580829+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:42:31.580829+0000","last_peered":"2024-04-25T09:42:31.580829+0000","last_clean":"2024-04-25T09:42:31.580829+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:42:31.580829+0000","last_undegraded":"2024-04-25T09:42:31.580829+0000","last_fullsized":"2024-04-25T09:42:31.580829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.650612+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:42:28.650612+0000","last_peered":"2024-04-25T09:42:28.650612+0000","last_clean":"2024-04-25T09:42:28.650612+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:42:28.650612+0000","last_undegraded":"2024-04-25T09:42:28.650612+0000","last_fullsized":"2024-04-25T09:42:28.650612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.555002+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:42:31.555002+0000","last_peered":"2024-04-25T09:42:31.555002+0000","last_clean":"2024-04-25T09:42:31.555002+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:42:31.555002+0000","last_undegraded":"2024-04-25T09:42:31.555002+0000","last_fullsized":"2024-04-25T09:42:31.555002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.655330+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:42:28.655330+0000","last_peered":"2024-04-25T09:42:28.655330+0000","last_clean":"2024-04-25T09:42:28.655330+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:42:28.655330+0000","last_undegraded":"2024-04-25T09:42:28.655330+0000","last_fullsized":"2024-04-25T09:42:28.655330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.568878+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:42:30.568878+0000","last_peered":"2024-04-25T09:42:30.568878+0000","last_clean":"2024-04-25T09:42:30.568878+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:42:30.568878+0000","last_undegraded":"2024-04-25T09:42:30.568878+0000","last_fullsized":"2024-04-25T09:42:30.568878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":267,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.571310+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:42:28.571310+0000","last_peered":"2024-04-25T09:42:28.571310+0000","last_clean":"2024-04-25T09:42:28.571310+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:42:28.571310+0000","last_undegraded":"2024-04-25T09:42:28.571310+0000","last_fullsized":"2024-04-25T09:42:28.571310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.563345+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:42:30.563345+0000","last_peered":"2024-04-25T09:42:30.563345+0000","last_clean":"2024-04-25T09:42:30.563345+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:42:30.563345+0000","last_undegraded":"2024-04-25T09:42:30.563345+0000","last_fullsized":"2024-04-25T09:42:30.563345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.578372+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:42:31.578372+0000","last_peered":"2024-04-25T09:42:31.578372+0000","last_clean":"2024-04-25T09:42:31.578372+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:42:31.578372+0000","last_undegraded":"2024-04-25T09:42:31.578372+0000","last_fullsized":"2024-04-25T09:42:31.578372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117608,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254232,"statfs":{"total":96636764160,"available":96516333568,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117624,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254216,"statfs":{"total":96636764160,"available":96516317184,"internally_reserved":0,"allocated":573440,"data_stored":780698,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130052,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241788,"statfs":{"total":96636764160,"available":96503590912,"internally_reserved":0,"allocated":520192,"data_stored":193226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126096,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245744,"statfs":{"total":96636764160,"available":96507641856,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:35.835 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:42:35.835 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:35.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:35.943+0000 7fca7586d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:35.945 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:35.950+0000 7fca7586d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:36.130 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:36.131 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:36.144 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-04-25T09:42:35.417569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491380,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":489024,"kb_avail":376995980,"statfs":{"total":386547056640,"available":386043883520,"internally_reserved":0,"allocated":2207744,"data_stored":2523736,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":500760576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"13'97","reported_seq":400,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.556064+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:42:28.556064+0000","last_peered":"2024-04-25T09:42:28.556064+0000","last_clean":"2024-04-25T09:42:28.556064+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:42:28.556064+0000","last_undegraded":"2024-04-25T09:42:28.556064+0000","last_fullsized":"2024-04-25T09:42:28.556064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.580829+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:42:31.580829+0000","last_peered":"2024-04-25T09:42:31.580829+0000","last_clean":"2024-04-25T09:42:31.580829+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:42:31.580829+0000","last_undegraded":"2024-04-25T09:42:31.580829+0000","last_fullsized":"2024-04-25T09:42:31.580829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.650612+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:42:28.650612+0000","last_peered":"2024-04-25T09:42:28.650612+0000","last_clean":"2024-04-25T09:42:28.650612+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:42:28.650612+0000","last_undegraded":"2024-04-25T09:42:28.650612+0000","last_fullsized":"2024-04-25T09:42:28.650612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.555002+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:42:31.555002+0000","last_peered":"2024-04-25T09:42:31.555002+0000","last_clean":"2024-04-25T09:42:31.555002+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:42:31.555002+0000","last_undegraded":"2024-04-25T09:42:31.555002+0000","last_fullsized":"2024-04-25T09:42:31.555002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.655330+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:42:28.655330+0000","last_peered":"2024-04-25T09:42:28.655330+0000","last_clean":"2024-04-25T09:42:28.655330+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:42:28.655330+0000","last_undegraded":"2024-04-25T09:42:28.655330+0000","last_fullsized":"2024-04-25T09:42:28.655330+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.568878+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:42:30.568878+0000","last_peered":"2024-04-25T09:42:30.568878+0000","last_clean":"2024-04-25T09:42:30.568878+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:42:30.568878+0000","last_undegraded":"2024-04-25T09:42:30.568878+0000","last_fullsized":"2024-04-25T09:42:30.568878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":267,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-25T09:42:28.571310+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:42:28.571310+0000","last_peered":"2024-04-25T09:42:28.571310+0000","last_clean":"2024-04-25T09:42:28.571310+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:42:28.571310+0000","last_undegraded":"2024-04-25T09:42:28.571310+0000","last_fullsized":"2024-04-25T09:42:28.571310+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-25T09:42:30.563345+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:42:30.563345+0000","last_peered":"2024-04-25T09:42:30.563345+0000","last_clean":"2024-04-25T09:42:30.563345+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:42:30.563345+0000","last_undegraded":"2024-04-25T09:42:30.563345+0000","last_fullsized":"2024-04-25T09:42:30.563345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.578372+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:42:31.578372+0000","last_peered":"2024-04-25T09:42:31.578372+0000","last_clean":"2024-04-25T09:42:31.578372+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:42:31.578372+0000","last_undegraded":"2024-04-25T09:42:31.578372+0000","last_fullsized":"2024-04-25T09:42:31.578372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117608,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254232,"statfs":{"total":96636764160,"available":96516333568,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117624,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254216,"statfs":{"total":96636764160,"available":96516317184,"internally_reserved":0,"allocated":573440,"data_stored":780698,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130052,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241788,"statfs":{"total":96636764160,"available":96503590912,"internally_reserved":0,"allocated":520192,"data_stored":193226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126096,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245744,"statfs":{"total":96636764160,"available":96507641856,"internally_reserved":0,"allocated":557056,"data_stored":774906,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:36.145 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:42:36.254 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:36.255+0000 7f3c65e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:36.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:36.263+0000 7f3c65e2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:36.446 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:36.447 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":117,"fsid":"cfb75e8d-0d7c-483d-8cd0-1bca1aba4fa2","created":"2024-04-25T09:27:34.287002+0000","modified":"2024-04-25T09:42:31.535275+0000","last_up_change":"2024-04-25T09:27:42.387533+0000","last_in_change":"2024-04-25T09:27:36.408151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:27:43.240966+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T09:27:44.537853+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"af2442cd-f1c9-4186-bdf0-ab333222ed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":1904214635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1904214635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":1904214635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":1904214635}]},"public_addr":"172.21.15.165:6805/1904214635","cluster_addr":"172.21.15.165:6804/1904214635","heartbeat_back_addr":"172.21.15.165:6812/1904214635","heartbeat_front_addr":"172.21.15.165:6813/1904214635","state":["exists","up"]},{"osd":1,"uuid":"7da7b933-c457-4964-a7fc-3836a553a9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":3016225021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":3016225021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":3016225021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":3016225021}]},"public_addr":"172.21.15.165:6802/3016225021","cluster_addr":"172.21.15.165:6801/3016225021","heartbeat_back_addr":"172.21.15.165:6817/3016225021","heartbeat_front_addr":"172.21.15.165:6816/3016225021","state":["exists","up"]},{"osd":2,"uuid":"79f2c880-b5ea-4a4a-b956-def489fb2147","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":2001234603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2001234603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":2001234603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2001234603}]},"public_addr":"172.21.15.172:6805/2001234603","cluster_addr":"172.21.15.172:6804/2001234603","heartbeat_back_addr":"172.21.15.172:6812/2001234603","heartbeat_front_addr":"172.21.15.172:6809/2001234603","state":["exists","up"]},{"osd":3,"uuid":"8bb3a063-42d3-47b0-86ee-5ae57576a4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6811","nonce":768266283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":768266283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6807","nonce":768266283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":768266283}]},"public_addr":"172.21.15.172:6811/768266283","cluster_addr":"172.21.15.172:6810/768266283","heartbeat_back_addr":"172.21.15.172:6807/768266283","heartbeat_front_addr":"172.21.15.172:6808/768266283","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:42:37.461 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T09:42:37.461 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:42:37.580 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:37.576+0000 7f8fd199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:37.584 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:37.589+0000 7f8fd199d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:37.597 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T09:42:37.597 INFO:teuthology.orchestra.run.smithi165.stdout: "success": "" 2024-04-25T09:42:37.597 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T09:42:37.609 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T09:42:37.718 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:37.718+0000 7fd97f79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:37.721 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:37.726+0000 7fd97f79d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:37.907 INFO:teuthology.orchestra.run.smithi165.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T09:42:37.926 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T09:42:37.926 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:42:38.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.033+0000 7f2a7ed9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.041 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.046+0000 7f2a7ed9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.056 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T09:42:38.056 INFO:teuthology.orchestra.run.smithi165.stdout: "success": "" 2024-04-25T09:42:38.056 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T09:42:38.068 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T09:42:38.175 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.175+0000 7f3d0a26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.184+0000 7f3d0a26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.365 INFO:teuthology.orchestra.run.smithi165.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T09:42:38.383 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T09:42:38.383 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:42:38.495 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.492+0000 7fbfe455d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.499 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.504+0000 7fbfe455d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.516 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T09:42:38.517 INFO:teuthology.orchestra.run.smithi165.stdout: "success": "" 2024-04-25T09:42:38.517 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T09:42:38.528 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T09:42:38.636 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.636+0000 7f931346d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.640 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.645+0000 7f931346d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.828 INFO:teuthology.orchestra.run.smithi165.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T09:42:38.843 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T09:42:38.843 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:42:38.955 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.951+0000 7f6fdee6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.958 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:38.963+0000 7f6fdee6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:38.976 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-04-25T09:42:38.976 INFO:teuthology.orchestra.run.smithi165.stdout: "success": "" 2024-04-25T09:42:38.976 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-04-25T09:42:38.987 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T09:42:39.095 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:39.095+0000 7fdd5979d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:39.098 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:39.103+0000 7fdd5979d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:39.287 INFO:teuthology.orchestra.run.smithi165.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T09:42:39.301 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:39.409 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:39.410+0000 7f1c08f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:39.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:39.418+0000 7f1c08f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:39.598 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:39.599 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:39.611 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":559,"stamp":"2024-04-25T09:42:39.418627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491268,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":489024,"kb_avail":376996092,"statfs":{"total":386547056640,"available":386043998208,"internally_reserved":0,"allocated":2265088,"data_stored":2544008,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":500760576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.886283"},"pg_stats":[{"pgid":"1.0","version":"13'97","reported_seq":405,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:32.635067+0000","last_change":"2024-04-25T09:27:44.456474+0000","last_active":"2024-04-25T09:42:32.635067+0000","last_peered":"2024-04-25T09:42:32.635067+0000","last_clean":"2024-04-25T09:42:32.635067+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:42:32.635067+0000","last_undegraded":"2024-04-25T09:42:32.635067+0000","last_fullsized":"2024-04-25T09:42:32.635067+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:43.392388+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.580829+0000","last_change":"2024-04-25T09:27:46.560366+0000","last_active":"2024-04-25T09:42:31.580829+0000","last_peered":"2024-04-25T09:42:31.580829+0000","last_clean":"2024-04-25T09:42:31.580829+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:42:31.580829+0000","last_undegraded":"2024-04-25T09:42:31.580829+0000","last_fullsized":"2024-04-25T09:42:31.580829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":266,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:34.612793+0000","last_change":"2024-04-25T09:27:46.576675+0000","last_active":"2024-04-25T09:42:34.612793+0000","last_peered":"2024-04-25T09:42:34.612793+0000","last_clean":"2024-04-25T09:42:34.612793+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:42:34.612793+0000","last_undegraded":"2024-04-25T09:42:34.612793+0000","last_fullsized":"2024-04-25T09:42:34.612793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.555002+0000","last_change":"2024-04-25T09:27:46.539868+0000","last_active":"2024-04-25T09:42:31.555002+0000","last_peered":"2024-04-25T09:42:31.555002+0000","last_clean":"2024-04-25T09:42:31.555002+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:42:31.555002+0000","last_undegraded":"2024-04-25T09:42:31.555002+0000","last_fullsized":"2024-04-25T09:42:31.555002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":266,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:34.584745+0000","last_change":"2024-04-25T09:27:46.566285+0000","last_active":"2024-04-25T09:42:34.584745+0000","last_peered":"2024-04-25T09:42:34.584745+0000","last_clean":"2024-04-25T09:42:34.584745+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:42:34.584745+0000","last_undegraded":"2024-04-25T09:42:34.584745+0000","last_fullsized":"2024-04-25T09:42:34.584745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":274,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:34.563292+0000","last_change":"2024-04-25T09:27:46.597019+0000","last_active":"2024-04-25T09:42:34.563292+0000","last_peered":"2024-04-25T09:42:34.563292+0000","last_clean":"2024-04-25T09:42:34.563292+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:42:34.563292+0000","last_undegraded":"2024-04-25T09:42:34.563292+0000","last_fullsized":"2024-04-25T09:42:34.563292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":272,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:32.663215+0000","last_change":"2024-04-25T09:27:46.585424+0000","last_active":"2024-04-25T09:42:32.663215+0000","last_peered":"2024-04-25T09:42:32.663215+0000","last_clean":"2024-04-25T09:42:32.663215+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:42:32.663215+0000","last_undegraded":"2024-04-25T09:42:32.663215+0000","last_fullsized":"2024-04-25T09:42:32.663215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":274,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:34.591689+0000","last_change":"2024-04-25T09:27:46.578857+0000","last_active":"2024-04-25T09:42:34.591689+0000","last_peered":"2024-04-25T09:42:34.591689+0000","last_clean":"2024-04-25T09:42:34.591689+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:42:34.591689+0000","last_undegraded":"2024-04-25T09:42:34.591689+0000","last_fullsized":"2024-04-25T09:42:34.591689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":264,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:31.578372+0000","last_change":"2024-04-25T09:27:46.567491+0000","last_active":"2024-04-25T09:42:31.578372+0000","last_peered":"2024-04-25T09:42:31.578372+0000","last_clean":"2024-04-25T09:42:31.578372+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:42:31.578372+0000","last_undegraded":"2024-04-25T09:42:31.578372+0000","last_fullsized":"2024-04-25T09:42:31.578372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:27:45.460624+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117632,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254208,"statfs":{"total":96636764160,"available":96516308992,"internally_reserved":0,"allocated":581632,"data_stored":783594,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117632,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254208,"statfs":{"total":96636764160,"available":96516308992,"internally_reserved":0,"allocated":581632,"data_stored":783594,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130052,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241788,"statfs":{"total":96636764160,"available":96503590912,"internally_reserved":0,"allocated":520192,"data_stored":193226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125952,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245888,"statfs":{"total":96636764160,"available":96507789312,"internally_reserved":0,"allocated":581632,"data_stored":783594,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:39.615 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T09:27:43.392388+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.615 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.615 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.616 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.616 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.616 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.616 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.616 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.616 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T09:27:45.460624+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=27, tm_sec=45, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=42, tm_sec=36, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:42:39.616 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T09:42:59.617 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:42:59.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:59.739+0000 7f2717f54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:59.742 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:42:59.747+0000 7f2717f54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:42:59.930 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-04-25T09:42:59.930 INFO:teuthology.orchestra.run.smithi165.stderr:dumped all 2024-04-25T09:42:59.943 INFO:teuthology.orchestra.run.smithi165.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2024-04-25T09:42:59.423658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":491268,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":489024,"kb_avail":376996092,"statfs":{"total":386547056640,"available":386043998208,"internally_reserved":0,"allocated":2265088,"data_stored":2544008,"data_compressed":89901,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":500760576},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003148"},"pg_stats":[{"pgid":"1.0","version":"13'97","reported_seq":407,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:39.295131+0000","last_change":"2024-04-25T09:42:39.317725+0000","last_active":"2024-04-25T09:42:39.295131+0000","last_peered":"2024-04-25T09:42:39.295131+0000","last_clean":"2024-04-25T09:42:39.295131+0000","last_became_active":"2024-04-25T09:27:44.451552+0000","last_became_peered":"2024-04-25T09:27:44.451552+0000","last_unstale":"2024-04-25T09:42:39.295131+0000","last_undegraded":"2024-04-25T09:42:39.295131+0000","last_fullsized":"2024-04-25T09:42:39.295131+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'97","last_scrub_stamp":"2024-04-25T09:42:39.317459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:39.317459+0000","last_clean_scrub_stamp":"2024-04-25T09:27:43.392388+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":266,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:38.374837+0000","last_change":"2024-04-25T09:42:38.388880+0000","last_active":"2024-04-25T09:42:38.374837+0000","last_peered":"2024-04-25T09:42:38.374837+0000","last_clean":"2024-04-25T09:42:38.374837+0000","last_became_active":"2024-04-25T09:27:46.554738+0000","last_became_peered":"2024-04-25T09:27:46.554738+0000","last_unstale":"2024-04-25T09:42:38.374837+0000","last_undegraded":"2024-04-25T09:42:38.374837+0000","last_fullsized":"2024-04-25T09:42:38.374837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:38.388666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:38.388666+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":268,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:37.915343+0000","last_change":"2024-04-25T09:42:37.926350+0000","last_active":"2024-04-25T09:42:37.915343+0000","last_peered":"2024-04-25T09:42:37.915343+0000","last_clean":"2024-04-25T09:42:37.915343+0000","last_became_active":"2024-04-25T09:27:46.571613+0000","last_became_peered":"2024-04-25T09:27:46.571613+0000","last_unstale":"2024-04-25T09:42:37.915343+0000","last_undegraded":"2024-04-25T09:42:37.915343+0000","last_fullsized":"2024-04-25T09:42:37.915343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:37.926173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:37.926173+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":266,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:38.373429+0000","last_change":"2024-04-25T09:42:38.386823+0000","last_active":"2024-04-25T09:42:38.373429+0000","last_peered":"2024-04-25T09:42:38.373429+0000","last_clean":"2024-04-25T09:42:38.373429+0000","last_became_active":"2024-04-25T09:27:46.534914+0000","last_became_peered":"2024-04-25T09:27:46.534914+0000","last_unstale":"2024-04-25T09:42:38.373429+0000","last_undegraded":"2024-04-25T09:42:38.373429+0000","last_fullsized":"2024-04-25T09:42:38.373429+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:38.386545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:38.386545+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":268,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:37.915345+0000","last_change":"2024-04-25T09:42:37.928125+0000","last_active":"2024-04-25T09:42:37.915345+0000","last_peered":"2024-04-25T09:42:37.915345+0000","last_clean":"2024-04-25T09:42:37.915345+0000","last_became_active":"2024-04-25T09:27:46.558776+0000","last_became_peered":"2024-04-25T09:27:46.558776+0000","last_unstale":"2024-04-25T09:42:37.915345+0000","last_undegraded":"2024-04-25T09:42:37.915345+0000","last_fullsized":"2024-04-25T09:42:37.915345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:37.927934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:37.927934+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:38.836141+0000","last_change":"2024-04-25T09:42:38.847417+0000","last_active":"2024-04-25T09:42:38.836141+0000","last_peered":"2024-04-25T09:42:38.836141+0000","last_clean":"2024-04-25T09:42:38.836141+0000","last_became_active":"2024-04-25T09:27:46.590994+0000","last_became_peered":"2024-04-25T09:27:46.590994+0000","last_unstale":"2024-04-25T09:42:38.836141+0000","last_undegraded":"2024-04-25T09:42:38.836141+0000","last_fullsized":"2024-04-25T09:42:38.836141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:38.847207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:38.847207+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":274,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:39.296703+0000","last_change":"2024-04-25T09:42:39.312844+0000","last_active":"2024-04-25T09:42:39.296703+0000","last_peered":"2024-04-25T09:42:39.296703+0000","last_clean":"2024-04-25T09:42:39.296703+0000","last_became_active":"2024-04-25T09:27:46.579268+0000","last_became_peered":"2024-04-25T09:27:46.579268+0000","last_unstale":"2024-04-25T09:42:39.296703+0000","last_undegraded":"2024-04-25T09:42:39.296703+0000","last_fullsized":"2024-04-25T09:42:39.296703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:39.312520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:39.312520+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":276,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:38.836105+0000","last_change":"2024-04-25T09:42:38.846602+0000","last_active":"2024-04-25T09:42:38.836105+0000","last_peered":"2024-04-25T09:42:38.836105+0000","last_clean":"2024-04-25T09:42:38.836105+0000","last_became_active":"2024-04-25T09:27:46.571313+0000","last_became_peered":"2024-04-25T09:27:46.571313+0000","last_unstale":"2024-04-25T09:42:38.836105+0000","last_undegraded":"2024-04-25T09:42:38.836105+0000","last_fullsized":"2024-04-25T09:42:38.836105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:38.846362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:38.846362+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":266,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-25T09:42:38.375002+0000","last_change":"2024-04-25T09:42:38.391462+0000","last_active":"2024-04-25T09:42:38.375002+0000","last_peered":"2024-04-25T09:42:38.375002+0000","last_clean":"2024-04-25T09:42:38.375002+0000","last_became_active":"2024-04-25T09:27:46.561321+0000","last_became_peered":"2024-04-25T09:27:46.561321+0000","last_unstale":"2024-04-25T09:42:38.375002+0000","last_undegraded":"2024-04-25T09:42:38.375002+0000","last_fullsized":"2024-04-25T09:42:38.375002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:42:38.391288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:42:38.391288+0000","last_clean_scrub_stamp":"2024-04-25T09:27:45.460624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117632,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254208,"statfs":{"total":96636764160,"available":96516308992,"internally_reserved":0,"allocated":581632,"data_stored":783594,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117632,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94254208,"statfs":{"total":96636764160,"available":96516308992,"internally_reserved":0,"allocated":581632,"data_stored":783594,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706577,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130052,"kb_used_data":508,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241788,"statfs":{"total":96636764160,"available":96503590912,"internally_reserved":0,"allocated":520192,"data_stored":193226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706577,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125952,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245888,"statfs":{"total":96636764160,"available":96507789312,"internally_reserved":0,"allocated":581632,"data_stored":783594,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29967,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:42:59.945 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T09:43:00.052 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:43:00.050+0000 7ff97746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:43:00.056 INFO:teuthology.orchestra.run.smithi165.stderr:2024-04-25T09:43:00.061+0000 7ff97746d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-25T09:43:00.265 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T09:43:00.265 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T09:43:00.266 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T09:43:00.266 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:43:00.351 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T09:43:00.352 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T09:43:00.352 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:43:00.448 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T09:43:00.448 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T09:43:00.449 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:43:00.543 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T09:43:00.544 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T09:43:00.544 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:43:00.638 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T09:43:00.638 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T09:43:00.638 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T09:43:00.638 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:43:00.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-25T09:43:00.665 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T09:43:00.666 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T09:43:00.666 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T09:43:00.666 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:43:00.678 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T09:43:00.678 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T09:43:00.679 DEBUG:teuthology.orchestra.run.smithi165:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-25T09:43:00.752 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T09:43:00.752 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T09:43:00.937 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T09:43:00.938 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T09:43:01.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T09:43:01.059 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T09:43:01.162 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T09:43:01.162 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T09:43:01.259 INFO:tasks.ceph:Archiving mon data... 2024-04-25T09:43:01.260 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/data/mon.a.tgz 2024-04-25T09:43:01.260 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-04-25T09:43:01.275 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.ifLRqZesJY 2024-04-25T09:43:01.275 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ifLRqZesJY 2024-04-25T09:43:01.387 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.ifLRqZesJY 2024-04-25T09:43:01.468 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.ifLRqZesJY is 240KB 2024-04-25T09:43:01.562 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.ifLRqZesJY 2024-04-25T09:43:01.576 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T09:43:01.576 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:43:01.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:43:01.694 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:43:01.711 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:43:01.711 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T09:43:01.712 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/remote/smithi165/crash 2024-04-25T09:43:01.713 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:43:01.757 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/remote/smithi172/crash 2024-04-25T09:43:01.758 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:43:01.789 INFO:tasks.ceph:Compressing logs... 2024-04-25T09:43:01.790 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:43:01.801 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26988.log 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27028.log 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.26988.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.26988.log.gz 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27068.log 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.27028.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27028.log.gz 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.27068.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T09:43:01.864 INFO:teuthology.orchestra.run.smithi172.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27068.log.gz 2024-04-25T09:43:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26948.log 2024-04-25T09:43:01.865 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.26948.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.26948.log.gz 2024-04-25T09:43:01.984 INFO:teuthology.orchestra.run.smithi172.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T09:43:02.080 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2024-04-25T09:43:02.080 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59059.log 2024-04-25T09:43:02.080 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38179.log 2024-04-25T09:43:02.080 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2024-04-25T09:43:02.080 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40644.log 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41582.log 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38179.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59059.log.gz 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38179.log.gz 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59999.log 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40644.log.gz 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41582.log.gz 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62852.log 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59999.log.gz 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59683.log 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34364.log 2024-04-25T09:43:02.081 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62852.log.gz 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59683.log.gz 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45985.log 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34364.log.gz 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28877.log 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49857.log 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45985.log.gz 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53204.log 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28877.log.gz 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41819.log 2024-04-25T09:43:02.082 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49857.log.gz 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36263.log 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53204.log.gz 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65232.log 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41819.log.gz 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35764.log 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36263.log.gz 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41311.log 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65232.log.gz 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55396.log 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35764.log.gz 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58216.log 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41311.log.gz 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58663.log 2024-04-25T09:43:02.083 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55396.log.gz 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38456.log 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58216.log.gz 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51751.log 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58663.log.gz 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.38456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58523.log 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51751.log.gz 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58523.log.gz 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36398.log 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56930.log 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-04-25T09:43:02.084 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62772.log 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36398.log.gz 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65441.log 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56930.log.gz 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55765.log 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62772.log.gz 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29122.log 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65441.log.gz 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56251.log 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55765.log.gz 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39275.log 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29122.log.gz 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37383.log 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56251.log.gz 2024-04-25T09:43:02.085 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35309.log 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39275.log.gz 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54769.log 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37383.log.gz 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65748.log 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35309.log.gz 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47419.log 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54769.log.gz 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45369.log 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65748.log.gz 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56029.log 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47419.log.gz 2024-04-25T09:43:02.086 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39359.log 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45369.log.gz 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62554.log 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56029.log.gz 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59508.log 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39359.log.gz 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44502.log 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62554.log.gz 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28457.log 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59508.log.gz 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55307.log 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44502.log.gz 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32271.log 2024-04-25T09:43:02.087 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28457.log.gz 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43398.log 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55307.log.gz 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29322.log 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32271.log.gz 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55636.log 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43398.log.gz 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44270.log 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29322.log.gz 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49227.log 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.55636.log.gz 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63704.log 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44270.log.gz 2024-04-25T09:43:02.088 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39560.log 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49227.log.gz 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37850.log 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.63704.log.gz 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42735.log 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39560.log.gz 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37850.log.gz 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42553.log 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42735.log.gz 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66401.log 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32351.log 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42553.log.gz 2024-04-25T09:43:02.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60588.log 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66401.log.gz 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27735.log 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32351.log.gz 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67436.log 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60588.log.gz 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27735.log.gz 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36314.log 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67436.log.gz 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39401.log 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28013.log 2024-04-25T09:43:02.090 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.36314.log.gz 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39401.log.gz 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37652.log 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28013.log.gz 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66050.log 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gz 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60728.log 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37652.log.gz 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37254.log 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66050.log.gz 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62950.log 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60728.log.gz 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57818.log 2024-04-25T09:43:02.091 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37254.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40254.log 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62950.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54273.log 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57818.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-client.admin.40254.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55038.log 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40254.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36132.log 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.54273.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28181.log 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55038.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-client.admin.36132.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42455.log 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36132.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28181.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28181.log.gz 2024-04-25T09:43:02.092 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45727.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42455.log.gz 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30039.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-client.admin.45727.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58572.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45727.log.gz 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65619.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.30039.log.gz 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62336.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58572.log.gz 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31656.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65619.log.gz 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62007.log 2024-04-25T09:43:02.093 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62336.log.gz 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57320.log 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31656.log.gz 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56881.log 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62007.log.gz 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57320.log.gz 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36704.log 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56881.log.gz 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67016.log 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36518.log 2024-04-25T09:43:02.094 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36704.log.gz 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67016.log.gz 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66571.log 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36518.log.gz 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28961.log 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66402.log 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66571.log.gz 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64994.log 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28961.log.gz 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64954.log 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66402.log.gz 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65490.log 2024-04-25T09:43:02.095 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64994.log.gz 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34763.log 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64954.log.gz 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63744.log 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65490.log.gz 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33018.log 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34763.log.gz 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42146.log 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63744.log.gz 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33018.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33018.log.gz 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61643.log 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42146.log.gz 2024-04-25T09:43:02.096 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29473.log 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57927.log 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61643.log.gz 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61816.log 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29473.log.gz 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59817.log 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57927.log.gz 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61816.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61816.log.gz 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66720.log 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59817.log.gz 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30438.log 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.66720.log.gz 2024-04-25T09:43:02.097 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61601.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43487.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30438.log.gz 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33325.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61601.log.gz 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56384.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43487.log.gz 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47576.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33325.log.gz 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46594.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56384.log.gz 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.47576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28709.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52275.log 2024-04-25T09:43:02.098 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46594.log.gz 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48050.log 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28709.log.gz 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39947.log 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52275.log.gz 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56425.log 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48050.log.gz 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50849.log 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39947.log.gz 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56425.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56425.log.gz 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58921.log 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35041.log 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50849.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50849.log.gz 2024-04-25T09:43:02.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58921.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58921.log.gz 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64567.log 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45538.log 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35041.log.gz 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64567.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.64567.log.gz 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63606.log 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46643.log 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45538.log.gz 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60986.log 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63606.log.gz 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63159.log 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46643.log.gz 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62287.log 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60986.log.gz 2024-04-25T09:43:02.100 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53617.log 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63159.log.gz 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43785.log 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62287.log.gz 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37612.log 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53617.log.gz 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43785.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43785.log.gz 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52800.log 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58354.log 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37612.log.gz 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41271.log 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52800.log.gz 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53568.log 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58354.log.gz 2024-04-25T09:43:02.101 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52433.log 49.6% 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41271.log.gz 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53568.log.gz 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28289.log 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52433.log.gz 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48131.log 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28289.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.28289.log.gz --verbose 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.63477.log 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30810.log 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48131.log.gz 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30285.log 2024-04-25T09:43:02.102 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63477.log.gz 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50940.log 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30810.log.gz 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30285.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.30285.log.gz --verbose 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.42693.log 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46223.log 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50940.log.gz 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61122.log 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42693.log.gz 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28561.log 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46223.log.gz 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53071.log 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61122.log.gz 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2024-04-25T09:43:02.103 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28561.log.gz 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53071.log: gzip 50.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.53071.log.gz 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61916.log 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60188.log 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54909.log 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61916.log.gz 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39849.log 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60188.log.gz 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40067.log 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54909.log.gz 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54322.log 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.39849.log.gz 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55984.log 2024-04-25T09:43:02.104 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40067.log.gz 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58970.log 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54322.log.gz 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45189.log 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55984.log.gz 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60679.log 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58970.log.gz 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52979.log 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45189.log.gz 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53288.log 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60679.log.gz 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50284.log 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52979.log.gz 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57678.log 2024-04-25T09:43:02.105 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53288.log.gz 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50284.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50284.log.gz -5 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49992.log 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52631.log 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57678.log.gz 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61142.log 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49992.log.gz 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52631.log.gz 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63962.log 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61142.log.gz 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41968.log 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37334.log 2024-04-25T09:43:02.106 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63962.log.gz 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51882.log 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41968.log.gz 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31724.log 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37334.log.gz 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51882.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51882.log.gz 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38702.log 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31724.log.gz 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43527.log 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38702.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38702.log.gz 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31446.log 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37027.log 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43527.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43527.log.gz 2024-04-25T09:43:02.107 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52053.log 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31446.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56581.log 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37027.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46314.log 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52053.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52053.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53875.log 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56581.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46314.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55447.log 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53875.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41540.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.40953.log -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-04-25T09:43:02.108 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51638.log 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55447.log.gz 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40953.log.gz 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62385.log 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51638.log.gz 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30579.log 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62385.log.gz 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54998.log 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2024-04-25T09:43:02.109 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55894.log 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30579.log.gz 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51812.log 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54998.log.gz 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54182.log 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55894.log.gz 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64914.log 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51812.log.gz 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67352.log 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54182.log.gz 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30950.log 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64914.log.gz 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34413.log 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67352.log.gz 2024-04-25T09:43:02.110 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41142.log 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30950.log.gz 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34413.log.gz 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61355.log 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41142.log.gz 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60938.log 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51029.log 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61355.log.gz 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63397.log 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60938.log.gz 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51029.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51029.log.gz 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51198.log 2024-04-25T09:43:02.111 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46812.log 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63397.log.gz 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51198.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51198.log.gz 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50891.log 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34533.log 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46812.log.gz 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50891.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50891.log.gz 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51129.log 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34315.log 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34533.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34533.log.gz 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38302.log 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51129.log.gz 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64736.log 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34315.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34315.log.gz 2024-04-25T09:43:02.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50444.log 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38302.log.gz 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64736.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64736.log.gz 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29536.log 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50711.log 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50444.log.gz 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29536.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29536.log.gz 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32082.log 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47724.log 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50711.log.gz 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32082.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32082.log.gz 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57360.log 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31804.log 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47724.log.gz 2024-04-25T09:43:02.113 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46772.log 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57360.log.gz 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60817.log 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31804.log.gz 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40517.log 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60817.log.gz 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37294.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz --verbose 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.34623.log 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59417.log 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40517.log.gz 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64785.log 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34623.log.gz 2024-04-25T09:43:02.114 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33543.log 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59417.log.gz 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64785.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64785.log.gz 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51792.log 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58881.log 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33543.log.gz 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51478.log 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51792.log.gz 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54720.log 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58881.log.gz 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45489.log 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51478.log.gz 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34155.log 2024-04-25T09:43:02.115 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54720.log.gz 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62594.log 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45489.log.gz 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47299.log 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34155.log.gz 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43292.log 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62594.log.gz 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39499.log 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47299.log.gz 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60857.log 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50671.log 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39499.log.gz 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53328.log 2024-04-25T09:43:02.116 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60857.log.gz 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62692.log 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50671.log.gz 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52324.log 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53328.log.gz 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43656.log 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62692.log.gz 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62245.log 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52324.log.gz 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43656.log.gz 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-client.admin.62245.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37474.log 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62245.log.gz 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66848.log 2024-04-25T09:43:02.117 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60497.log 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37474.log.gz 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49136.log 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66848.log.gz 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38088.log 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60497.log.gz 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56335.log 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49136.log.gz 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41351.log 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38088.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38088.log.gz 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60146.log 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56335.log.gz 2024-04-25T09:43:02.118 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32649.log 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41351.log.gz 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60146.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.63119.log 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60146.log.gz 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63079.log 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32649.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32649.log.gz 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59182.log 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63119.log.gz 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45816.log 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63079.log.gz 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41927.log 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59182.log.gz 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45816.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45816.log.gz 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28393.log 2024-04-25T09:43:02.119 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59641.log 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41927.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41927.log.gz 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28393.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28393.log.gz 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41231.log 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59641.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59641.log.gz 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38960.log 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29910.log 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41231.log.gz 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64874.log 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38960.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38960.log.gz 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49407.log 2024-04-25T09:43:02.120 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29910.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58841.log 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64874.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38384.log 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49407.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49407.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35640.log 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58841.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36181.log 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38384.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64429.log 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35640.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35640.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36181.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54860.log 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64429.log.gz 2024-04-25T09:43:02.121 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34812.log 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43042.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46732.log 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54860.log.gz 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63036.log 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34812.log.gz 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32738.log 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46732.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46732.log.gz 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55496.log 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63036.log.gz 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32738.log: gzip 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32738.log.gz 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32927.log 2024-04-25T09:43:02.122 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63784.log 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55496.log.gz 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65394.log 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32927.log.gz 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30719.log 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63784.log.gz 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65394.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65394.log.gz 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57280.log 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53697.log 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30719.log.gz 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57280.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26124.log 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57280.log.gz 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29828.log 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53697.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53697.log.gz 2024-04-25T09:43:02.123 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph.tmp-client.admin.26124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33374.log 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26124.log.gz 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29828.log.gz 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33283.log 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33374.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33374.log.gz 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39142.log 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33283.log.gz 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45856.log 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45280.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58761.log 2024-04-25T09:43:02.124 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39142.log.gz 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37781.log 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45856.log.gz 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43262.log 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58761.log: /var/log/ceph/ceph-client.admin.37781.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58761.log.gz 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33930.log 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37781.log.gz 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61035.log 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43262.log.gz 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58314.log 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33930.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33930.log.gz 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61035.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.61035.log.gz 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65797.log 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65332.log 2024-04-25T09:43:02.125 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58314.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58314.log.gz 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53428.log 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65797.log.gz 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34453.log 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65332.log.gz 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-client.admin.53428.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33503.log 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53428.log.gz 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38562.log 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34453.log.gz 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30768.log 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33503.log.gz 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37214.log 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38562.log.gz 2024-04-25T09:43:02.126 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30768.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30768.log.gz 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49185.log 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50989.log 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37214.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37214.log.gz 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30670.log 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49185.log.gz 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67268.log 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50989.log.gz 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66699.log 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30670.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30670.log.gz 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65043.log 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67268.log.gz 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35081.log 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66699.log.gz 2024-04-25T09:43:02.127 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33890.log 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65043.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65043.log.gz 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28373.log 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35081.log.gz 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64102.log 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.33890.log.gz 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31357.log 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28373.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28373.log.gz 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30530.log 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64102.log.gz 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31357.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31357.log.gz 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32878.log 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30530.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30530.log.gz 2024-04-25T09:43:02.128 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32836.log 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60384.log 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32878.log.gz 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52010.log 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32836.log.gz 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64062.log 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60384.log.gz 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52010.log.gz 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43865.log 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64062.log.gz 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47361.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62105.log 2024-04-25T09:43:02.129 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53246.log 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43865.log.gz 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62105.log.gz 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53246.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.55078.log 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53246.log.gz 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46990.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gz 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.27456.log 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65881.log 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55078.log.gz 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58125.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27456.log.gz 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65881.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65881.log.gz 2024-04-25T09:43:02.130 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47070.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63348.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58125.log.gz 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47070.log: gzip -5 --verbose -- 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47070.log.gz 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.admin.35908.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63348.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63348.log.gz 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64309.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33116.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35908.log.gz 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38424.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64309.log.gz 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42364.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33116.log.gz 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr:gzip/var/log/ceph/ceph-client.admin.38424.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2024-04-25T09:43:02.131 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42364.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42364.log.gz 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38513.log 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58394.log 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30221.log 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38513.log.gz 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34672.log 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58394.log.gz 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46074.log 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30221.log.gz 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52500.log 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34672.log.gz 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48311.log 2024-04-25T09:43:02.132 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46074.log.gz 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57489.log 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52500.log.gz 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28138.log 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48311.log.gz 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41469.log 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57489.log.gz 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28138.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28138.log.gz 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67310.log 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41469.log.gz 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29300.log 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67310.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67310.log.gz 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.admin.40429.log 2024-04-25T09:43:02.133 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29300.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29300.log.gz 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60048.log 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40429.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40429.log.gz 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.admin.55943.log 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60048.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60048.log.gz 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55545.log 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55943.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55943.log.gz 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52938.log 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55545.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55545.log.gz 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48220.log 2024-04-25T09:43:02.134 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52938.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52938.log.gz 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.30999.log 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48220.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48220.log.gz 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41051.log 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30999.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30999.log.gz 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.35362.log 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41051.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41051.log.gz 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55685.log 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35362.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35362.log.gz 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55685.log: 48.8% -- replaced with /var/log/ceph/ceph-client.admin.55685.log.gz 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28835.log 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44172.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61212.log 2024-04-25T09:43:02.135 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28835.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28835.log.gz 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52394.log 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61212.log.gz 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52394.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59277.log 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52394.log.gz 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40088.log 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63824.log 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59277.log: /var/log/ceph/ceph-client.admin.40088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45231.log 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40088.log.gz 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59277.log.gz 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63824.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63824.log.gz 2024-04-25T09:43:02.136 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39184.log 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45231.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45231.log.gz 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58036.log 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39184.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39184.log.gz 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38653.log 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58036.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58036.log.gz 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41468.log 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49325.log 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38653.log: /var/log/ceph/ceph-client.admin.41468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62147.log 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38653.log.gz 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41468.log.gz 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49325.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49325.log.gz 2024-04-25T09:43:02.137 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.54446.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62147.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62147.log.gz 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31068.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54446.log: -- /var/log/ceph/ceph-client.admin.30480.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54446.log.gz 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31068.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31068.log.gz 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37692.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38128.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30480.log: /var/log/ceph/ceph-client.admin.37692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42226.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30480.log.gz 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37692.log.gz 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38128.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38128.log.gz 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61530.log 2024-04-25T09:43:02.138 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42226.log.gz 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39898.log 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44551.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61530.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61530.log.gz 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39898.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39898.log.gz 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54580.log 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44860.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.admin.35001.log 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54580.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54580.log.gz 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49541.log 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35001.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35001.log.gz 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35999.log 2024-04-25T09:43:02.139 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59368.log 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60097.log 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35999.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49541.log.gz 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35999.log.gz 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59368.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59368.log.gz 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.30263.log 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60097.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60097.log.gz 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30129.log 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.30263.log: /var/log/ceph/ceph-client.admin.63864.log 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30263.log.gz/var/log/ceph/ceph-client.admin.30129.log: 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30129.log.gz 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65966.log 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63864.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63864.log.gz 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34275.log 2024-04-25T09:43:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59859.log 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65966.log: /var/log/ceph/ceph-client.admin.34275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45678.log 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34275.log.gz 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65966.log.gz 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59859.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.59859.log.gz 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66532.log 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45678.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45678.log.gz 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61468.log 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47462.log 50.4% -- replaced with /var/log/ceph/ceph-client.admin.66532.log.gz 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61468.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57867.log 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61468.log.gz 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40562.log 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47462.log.gz 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30601.log 2024-04-25T09:43:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57867.log: /var/log/ceph/ceph-client.admin.40562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48351.log 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40562.log.gz 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57867.log.gz 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30601.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30601.log.gz 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40296.log 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48351.log.gz 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66260.log 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47504.log: /var/log/ceph/ceph-client.admin.40296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52889.log 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40296.log.gz 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66260.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66260.log.gz 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29121.log 2024-04-25T09:43:02.142 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52889.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52889.log.gz 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39539.log 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29121.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29121.log.gz 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58619.log 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39539.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39539.log.gz 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.admin.48091.log 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58619.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58619.log.gz 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55118.log 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48091.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48091.log.gz 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.50751.log 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55118.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55118.log.gz 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53162.log 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48444.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50751.log.gz 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.143 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53162.log: 48.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46503.log 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53162.log.gz 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48485.log 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48444.log.gz 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34195.log 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46503.log.gz 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35259.log 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48485.log: /var/log/ceph/ceph-client.admin.34195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57238.log 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34195.log.gz 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48485.log.gz 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35259.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35259.log.gz 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49591.log 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57238.log: gzip -5 50.0% --verbose -- /var/log/ceph/ceph-client.admin.51576.log 2024-04-25T09:43:02.144 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57238.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49591.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49591.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.admin.52233.log 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51576.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51576.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56741.log 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42953.log 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52233.log: /var/log/ceph/ceph-client.admin.56741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51387.log 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56741.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52233.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42953.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42953.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56476.log 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51387.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51387.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.admin.46405.log 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56476.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56476.log.gz 2024-04-25T09:43:02.145 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29023.log 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46405.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31844.log 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34235.log 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29023.log.gz 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40604.log 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31844.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31844.log.gzgzip 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67560.log 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34235.log: /var/log/ceph/ceph-client.admin.40604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36089.log 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40604.log.gz 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34235.log.gz 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67560.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67560.log.gz 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38871.log 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36089.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36089.log.gz 2024-04-25T09:43:02.146 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67100.log 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38871.log: /var/log/ceph/ceph-client.admin.55805.log 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4%/var/log/ceph/ceph-client.admin.67100.log: -- replaced with /var/log/ceph/ceph-client.admin.38871.log.gz 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67100.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59019.log 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.55805.log.gz 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56692.log 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59019.log: /var/log/ceph/ceph-client.admin.36356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55167.log 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59019.log.gz 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56692.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56692.log.gz 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65134.log 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55167.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55167.log.gz 2024-04-25T09:43:02.147 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37572.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65134.log: gzip 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65134.log.gz 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31586.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37572.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37572.log.gz 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35600.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35210.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63566.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35600.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31586.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35600.log.gz 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35210.log: gzip -5 49.2% -- replaced with /var/log/ceph/ceph-client.admin.35210.log.gz 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52680.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63566.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63566.log.gz 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66134.log 2024-04-25T09:43:02.148 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52680.log.gz 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47682.log 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44132.log: /var/log/ceph/ceph-client.admin.66134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55845.log 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66134.log.gz 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47682.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47682.log.gz 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57063.log 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55845.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55845.log.gz 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr: /var/log/ceph/ceph-client.admin.64171.log 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57063.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28751.log 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57063.log.gz 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28919.log 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64171.log.gz 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65312.log 2024-04-25T09:43:02.149 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28751.log: /var/log/ceph/ceph-client.admin.28919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28919.log.gz 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28751.log.gz 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65312.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65312.log.gz 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66403.log 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42008.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66403.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66403.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46901.log: /var/log/ceph/ceph-client.admin.54629.log: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2024-04-25T09:43:02.150 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28010.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59326.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44410.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28010.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28010.log.gz 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36985.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59326.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59326.log.gz 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42644.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60229.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36985.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36985.log.gz 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42644.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42644.log.gz 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27785.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60229.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60229.log.gz 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54224.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37913.log 2024-04-25T09:43:02.151 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27785.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27785.log.gz 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54224.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54224.log.gz 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41799.log 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37913.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37913.log.gz 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37958.log 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64389.log 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41799.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41799.log.gz 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37958.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37958.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31495.log 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64389.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64389.log.gz 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29431.log 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50591.log 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31495.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31495.log.gz 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29431.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29431.log.gz 2024-04-25T09:43:02.152 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64269.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50591.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50591.log.gz 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63437.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58076.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64269.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64269.log.gz 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63437.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63437.log.gz 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49717.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58076.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58076.log.gz 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57013.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31048.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49717.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49717.log.gz 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57013.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.57013.log.gz 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54084.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31048.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31048.log.gz 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46174.log 2024-04-25T09:43:02.153 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35502.log 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54084.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54084.log.gz 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46174.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46174.log.gz 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29739.log 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35502.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35502.log.gz 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66302.log 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55216.log 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29739.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29739.log.gz 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66302.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66302.log.gz 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63913.log 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55216.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.55216.log.gz 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66176.log 2024-04-25T09:43:02.154 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63913.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63913.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36887.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56521.log 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66176.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66176.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37830.log 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40205.log 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56521.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56521.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37830.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37830.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38751.log 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40205.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40205.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50404.log 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47773.log 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38751.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38751.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50404.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50404.log.gz 2024-04-25T09:43:02.155 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60372.log 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47773.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47773.log.gz 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60372.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60372.log.gz 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31764.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32122.log 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27827.log 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49633.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32122.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32122.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35700.log 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67394.log 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27827.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27827.log.gz 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35700.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35700.log.gz 2024-04-25T09:43:02.156 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57727.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64527.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57727.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67394.log.gz 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57727.log.gz 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35551.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51527.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64527.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64527.log.gz 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35551.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35551.log.gz 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42595.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51527.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51527.log.gz 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34106.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gz 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64834.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62812.log 2024-04-25T09:43:02.157 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42595.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42595.log.gz 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65092.log 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64834.log.gz 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47545.log 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65092.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62812.log.gz 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.65092.log.gz 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52127.log 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61510.log 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47545.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47545.log.gz 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.52127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38199.log 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61510.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61510.log.gz 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30859.log 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38199.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38199.log.gz 2024-04-25T09:43:02.158 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30859.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30859.log.gz 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38791.log 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41757.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60272.log 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38791.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38791.log.gz 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38039.log 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60272.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60272.log.gz 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38039.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38039.log.gz 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47208.log 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51925.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63208.log 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47208.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47208.log.gz 2024-04-25T09:43:02.159 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63208.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63208.log.gz 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63299.log 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34713.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57988.log 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63299.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63299.log.gz 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66974.log 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57988.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57988.log.gz 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40813.log 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66974.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66974.log.gz 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56561.log 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40813.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40813.log.gz 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56561.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56561.log.gz 2024-04-25T09:43:02.160 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44680.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32391.log 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48829.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52542.log 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32391.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32391.log.gz 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27679.log 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52542.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52542.log.gz 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60455.log 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27679.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27679.log.gz 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31984.log 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60455.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60455.log.gz 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-04-25T09:43:02.161 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31984.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31984.log.gz 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61734.log 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44092.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49766.log 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61734.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61734.log.gz 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52720.log 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49766.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49766.log.gz 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34952.log 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52720.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52720.log.gz 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34952.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34952.log.gz 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31397.log 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35859.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gz 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67478.log 2024-04-25T09:43:02.162 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31397.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31397.log.gz 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35950.log 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67478.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67478.log.gz 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35950.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35950.log.gz 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65539.log 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54044.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30908.log 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65539.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65539.log.gz 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44811.log 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30908.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30908.log.gz 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44811.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44811.log.gz 2024-04-25T09:43:02.163 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62643.log 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42266.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37712.log 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62643.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62643.log.gz 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32311.log 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37712.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37712.log.gz 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50144.log 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32311.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32311.log.gz 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32609.log 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50144.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50144.log.gz 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42406.log 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32609.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32609.log.gz 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48898.log 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42406.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42406.log.gz 2024-04-25T09:43:02.164 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64647.log 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48898.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48898.log.gz 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39009.log 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64647.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64647.log.gz 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65839.log 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39009.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39009.log.gz 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33768.log 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65839.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65839.log.gz 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33423.log 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33768.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33768.log.gz 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58174.log 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33423.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33423.log.gz 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-04-25T09:43:02.165 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58174.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58174.log.gz 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31188.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27271.log 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53029.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42057.log 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27271.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27271.log.gz 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54004.log 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42057.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42057.log.gz 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41191.log 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54004.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54004.log.gz 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53112.log 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41191.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41191.log.gz 2024-04-25T09:43:02.166 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53962.log 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53112.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53112.log.gz 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65659.log 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53962.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53962.log.gz 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46852.log 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65659.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65659.log.gz 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48700.log 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46852.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46852.log.gz 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36936.log 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48700.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48700.log.gz 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36936.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36936.log.gz 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63655.log 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48620.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz 2024-04-25T09:43:02.167 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55725.log 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63655.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63655.log.gz 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67184.log 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55725.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55725.log.gz 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52373.log 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67184.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67184.log.gz 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59599.log 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52373.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52373.log.gz 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54382.log 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59599.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59599.log.gz 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66572.log 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54382.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54382.log.gz 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56832.log 2024-04-25T09:43:02.168 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66572.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66572.log.gz 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64607.log 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56832.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.56832.log.gz 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67226.log 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64607.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64607.log.gz 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52096.log 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67226.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67226.log.gz 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38602.log 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52096.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52096.log.gz 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66700.log 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38602.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38602.log.gz 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55258.log 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66700.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66700.log.gz 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51709.log 2024-04-25T09:43:02.169 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55258.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55258.log.gz 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29690.log 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51709.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51709.log.gz 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29990.log 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29690.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29690.log.gz 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54531.log 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29990.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.29990.log.gz 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31277.log 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54531.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54531.log.gz 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47962.log 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31277.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31277.log.gz 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47962.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47962.log.gz 2024-04-25T09:43:02.170 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49815.log 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40387.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56158.log 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49815.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49815.log.gz 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61867.log 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56158.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56158.log.gz 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56293.log 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61867.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61867.log.gz 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56293.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56293.log.gz 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42833.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42106.log 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36845.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-04-25T09:43:02.171 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29120.log 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42106.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42106.log.gz 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51128.log 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29120.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29120.log.gz 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49003.log 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51128.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51128.log.gz 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63518.log 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49003.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49003.log.gz 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57145.log 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63518.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63518.log.gz 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56209.log 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57145.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57145.log.gz 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33674.log 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56209.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56209.log.gz 2024-04-25T09:43:02.172 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42504.log 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33674.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33674.log.gz 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28180.log 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42504.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42504.log.gz 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58801.log 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28180.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28180.log.gz 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48939.log 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58801.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58801.log.gz 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64349.log 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48939.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48939.log.gz 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47862.log 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64349.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64349.log.gz 2024-04-25T09:43:02.173 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29870.log 2024-04-25T09:43:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47862.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47862.log.gz 2024-04-25T09:43:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2024-04-25T09:43:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29870.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29870.log.gz 2024-04-25T09:43:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56635.log 2024-04-25T09:43:02.179 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43349.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67142.log 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.56635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62473.log 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67142.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67142.log.gz 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62473.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62473.log.gz 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61335.log 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47159.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33717.log 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61335.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61335.log.gz 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36558.log 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33717.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33717.log.gz 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51618.log 2024-04-25T09:43:02.180 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36558.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36558.log.gz 2024-04-25T09:43:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32431.log 2024-04-25T09:43:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51618.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51618.log.gz 2024-04-25T09:43:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29374.log 2024-04-25T09:43:02.181 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32431.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32431.log.gz 2024-04-25T09:43:02.182 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43178.log 2024-04-25T09:43:02.200 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.29374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43993.log 2024-04-25T09:43:02.200 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43178.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43178.log.gz 2024-04-25T09:43:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48171.log 2024-04-25T09:43:02.209 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43993.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43993.log.gz 2024-04-25T09:43:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29237.log 2024-04-25T09:43:02.218 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48171.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48171.log.gz 2024-04-25T09:43:02.237 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62196.log 2024-04-25T09:43:02.237 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29237.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29237.log.gz 2024-04-25T09:43:02.246 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66092.log 2024-04-25T09:43:02.246 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62196.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62196.log.gz 2024-04-25T09:43:02.256 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 2024-04-25T09:43:02.256 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66092.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66092.log.gz 2024-04-25T09:43:02.271 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66742.log 2024-04-25T09:43:02.271 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35121.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-04-25T09:43:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38911.log 2024-04-25T09:43:02.283 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66742.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66742.log.gz 2024-04-25T09:43:02.298 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53477.log 2024-04-25T09:43:02.298 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38911.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38911.log.gz 2024-04-25T09:43:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-04-25T09:43:02.308 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53477.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53477.log.gz 2024-04-25T09:43:02.323 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2024-04-25T09:43:02.323 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40027.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-04-25T09:43:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39807.log 2024-04-25T09:43:02.332 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45936.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2024-04-25T09:43:02.340 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.47576.log.gz 2024-04-25T09:43:02.346 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42913.log 2024-04-25T09:43:02.346 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39807.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39807.log.gz 2024-04-25T09:43:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44452.log 2024-04-25T09:43:02.356 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42913.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42913.log.gz 2024-04-25T09:43:02.376 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36223.log 2024-04-25T09:43:02.376 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44452.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44452.log.gz 2024-04-25T09:43:02.385 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59908.log 2024-04-25T09:43:02.385 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36223.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36223.log.gz 2024-04-25T09:43:02.399 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66218.log 2024-04-25T09:43:02.399 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59908.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.59908.log.gz 2024-04-25T09:43:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2024-04-25T09:43:02.408 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66218.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66218.log.gz 2024-04-25T09:43:02.423 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35161.log 2024-04-25T09:43:02.423 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45776.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2024-04-25T09:43:02.433 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2024-04-25T09:43:02.433 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35161.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35161.log.gz 2024-04-25T09:43:02.434 INFO:teuthology.orchestra.run.smithi165.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.43292.log.gz 2024-04-25T09:43:02.436 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61426.log 2024-04-25T09:43:02.437 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51967.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2024-04-25T09:43:02.437 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-04-25T09:43:02.437 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61426.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61426.log.gz 2024-04-25T09:43:02.437 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62732.log 2024-04-25T09:43:02.437 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39051.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59775.log 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62732.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62732.log.gz 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53379.log 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59775.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59775.log.gz 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29768.log 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53379.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53379.log.gz 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49276.log 2024-04-25T09:43:02.441 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29768.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29768.log.gz 2024-04-25T09:43:02.448 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30088.log 2024-04-25T09:43:02.448 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49276.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49276.log.gz 2024-04-25T09:43:02.448 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42784.log 2024-04-25T09:43:02.448 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30088.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30088.log.gz 2024-04-25T09:43:02.448 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53737.log 2024-04-25T09:43:02.448 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42784.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42784.log.gz 2024-04-25T09:43:02.448 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35680.log 2024-04-25T09:43:02.449 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53737.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53737.log.gz 2024-04-25T09:43:02.449 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-04-25T09:43:02.449 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35680.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35680.log.gz 2024-04-25T09:43:02.449 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2024-04-25T09:43:02.449 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42186.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-04-25T09:43:02.449 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27869.log 2024-04-25T09:43:02.449 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45409.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66404.log 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27869.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27869.log.gz 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48005.log 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66404.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66404.log.gz 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55356.log 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48005.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48005.log.gz 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50186.log 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55356.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55356.log.gz 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40470.log 2024-04-25T09:43:02.458 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50186.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50186.log.gz 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27427.log 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40470.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40470.log.gz 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40337.log 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27427.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.27427.log.gz 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52184.log 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40337.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40337.log.gz 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31317.log 2024-04-25T09:43:02.459 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52184.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52184.log.gz 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31237.log 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31317.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31317.log.gz 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31237.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31237.log.gz 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43745.log 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49087.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40684.log 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43745.log: 50.0% 93.8% -- replaced with /var/log/ceph/ceph-client.admin.43745.log.gz 2024-04-25T09:43:02.512 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.0.38456.log.gz 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28793.log 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40684.log: -- /var/log/ceph/ceph-client.admin.38831.log 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40684.log.gz 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62426.log 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6%/var/log/ceph/ceph-client.admin.38831.log: -- replaced with /var/log/ceph/ceph-client.admin.28793.log.gz 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38831.log.gz 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49906.log 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.62426.log: -- /var/log/ceph/ceph-client.admin.32173.log 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62426.log.gz 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49906.log.gz 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32173.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50364.log 2024-04-25T09:43:02.513 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66890.log 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39225.log 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66890.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50364.log.gz 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66890.log.gz 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46125.log 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59099.log 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39225.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46125.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46125.log.gz 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45091.log 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32033.log 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45091.log: /var/log/ceph/ceph-client.admin.59099.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59099.log.gz 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45091.log.gz 2024-04-25T09:43:02.514 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66932.log 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57769.log 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32033.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32033.log.gz 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66932.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66932.log.gz 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45329.log 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45329.log: /var/log/ceph/ceph-client.admin.57769.log: 49.2% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57769.log.gz 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45329.log.gz 2024-04-25T09:43:02.515 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47110.log 2024-04-25T09:43:02.517 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39668.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47110.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47110.log.gz 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46545.log 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48402.log 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46545.log: /var/log/ceph/ceph-client.admin.44640.log: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46545.log.gz 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27911.log 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48402.log: /var/log/ceph/ceph-client.admin.66531.log 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48402.log.gz 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53777.log 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66531.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.27911.log.gz 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66531.log.gz 2024-04-25T09:43:02.518 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46034.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58474.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53777.log.gz 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61077.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58474.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46034.log.gz 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58474.log.gz 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57907.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37523.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61077.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61077.log.gz 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57907.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57907.log.gzgzip 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32569.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62514.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37523.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37523.log.gz 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32569.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32569.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27192.log 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.519 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57196.log 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62514.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62514.log.gz 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.27192.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67520.log 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27192.log.gz 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57196.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57196.log.gz 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49458.log 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67520.log.gz 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39317.log 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49458.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49458.log.gz 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41715.log 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44598.log 2024-04-25T09:43:02.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39317.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39317.log.gz 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41715.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41715.log.gz 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36478.log 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62971.log 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44598.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44598.log.gz 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36478.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63257.log 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36478.log.gz 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31537.log 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.63257.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62971.log.gz 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63257.log.gz 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59733.log 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.31537.log: -- /var/log/ceph/ceph-client.admin.43607.log 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31537.log.gz 2024-04-25T09:43:02.521 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43607.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59733.log.gz 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39450.log 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34903.log 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43219.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39450.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39450.log.gz 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36796.log 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64220.log 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36796.log: /var/log/ceph/ceph-client.admin.34903.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36796.log.gz 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34903.log.gz 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53826.log 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50542.log 2024-04-25T09:43:02.522 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64220.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64220.log.gz 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53826.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53826.log.gz 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28011.log 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36747.log 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28011.log: /var/log/ceph/ceph-client.admin.50542.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28011.log.gz 50.0% 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50542.log.gz 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33583.log 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51069.log 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36747.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36747.log.gz 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33583.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33583.log.gz 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29950.log 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66008.log 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51069.log.gz 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56971.log 2024-04-25T09:43:02.523 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.66008.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29950.log.gz 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66008.log.gz 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54958.log 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29513.log 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56971.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.56971.log.gz 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54958.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28477.log 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54958.log.gz 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45140.log 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29513.log: /var/log/ceph/ceph-client.admin.28477.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29513.log.gz 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28477.log.gz 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33850.log 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45140.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57400.log 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45140.log.gz 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61685.log 2024-04-25T09:43:02.524 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33850.log: /var/log/ceph/ceph-client.admin.57400.log: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57400.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33850.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32480.log 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65579.log 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61685.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35810.log 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32480.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56790.log 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35810.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65579.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35810.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45040.log 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56790.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56790.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45040.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45040.log.gz 2024-04-25T09:43:02.525 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33463.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33463.log: /var/log/ceph/ceph-client.admin.45627.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33463.log.gz 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57440.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43084.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50324.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57440.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57440.log.gz 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28309.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52582.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28309.log: /var/log/ceph/ceph-client.admin.43084.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43084.log.gz 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28309.log.gz 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34057.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49047.log 2024-04-25T09:43:02.526 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52582.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52582.log.gz 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34057.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34057.log.gz 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43104.log 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35460.log 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43104.log: /var/log/ceph/ceph-client.admin.49047.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49047.log.gz 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43104.log.gz 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60886.log 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65272.log 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35460.log: /var/log/ceph/ceph-client.admin.60886.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35460.log.gz 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60886.log.gz 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34000.log 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55587.log 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65272.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65272.log.gz 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.34000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37076.log 2024-04-25T09:43:02.527 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.55587.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55587.log.gz 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53519.log 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37076.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37076.log.gz 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43914.log 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53519.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53519.log.gz 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61965.log 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43914.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43914.log.gz 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28141.log 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61965.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.61965.log.gz 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41002.log 2024-04-25T09:43:02.528 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28141.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28141.log.gz 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34861.log 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41002.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41002.log.gz 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41400.log 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34861.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34861.log.gz 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28541.log 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41400.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41400.log.gz 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42993.log 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28541.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28541.log.gz 2024-04-25T09:43:02.556 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54491.log 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.42993.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42993.log.gz 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59466.log 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54491.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54491.log.gz 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51338.log 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59466.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59466.log.gz 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46950.log 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51338.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51338.log.gz 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31635.log 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46950.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46950.log.gz 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51295.log 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31635.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31635.log.gz 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52760.log 2024-04-25T09:43:02.557 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51295.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51295.log.gz 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51436.log 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.52760.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52760.log.gz 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61776.log 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51436.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51436.log.gz 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61776.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61776.log.gz 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36607.log 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49500.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28012.log 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36607.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36607.log.gz 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61255.log 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28012.log: 93.8% 50.0% -- replaced with /var/log/ceph/ceph-client.0.52127.log.gz -- replaced with /var/log/ceph/ceph-client.admin.28012.log.gz 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.558 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43443.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.61255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42873.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43443.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61255.log.gz 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43443.log.gz 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59957.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42873.log: -- /var/log/ceph/ceph-client.admin.43705.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42873.log.gz 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30177.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43705.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59957.log.gz 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50095.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33176.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30177.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30177.log.gz 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50095.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50095.log.gz 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54133.log 2024-04-25T09:43:02.559 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33176.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33176.log.gz 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33238.log 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35411.log 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54133.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54133.log.gz 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33238.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33238.log.gz 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65699.log 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.35411.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35411.log.gz 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37167.log 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59119.log 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65699.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65699.log.gz 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37167.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37167.log.gz 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37999.log 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59119.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59119.log.gz 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39621.log 2024-04-25T09:43:02.560 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37999.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37999.log.gz 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39621.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39621.log.gz 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64687.log 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39091.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41093.log 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54811.log 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64687.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64687.log.gz 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41093.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41093.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62056.log 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54811.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54811.log.gz 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44761.log 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46265.log 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62056.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62056.log.gz 2024-04-25T09:43:02.561 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44761.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44761.log.gz 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39987.log 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46265.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46265.log.gz 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32976.log 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40724.log 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39987.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39987.log.gz 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32976.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32976.log.gz 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49955.log 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40724.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40724.log.gz 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64478.log 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38342.log 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49955.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49955.log.gz 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64478.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64478.log.gz 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47249.log 2024-04-25T09:43:02.562 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38342.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38342.log.gz 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30354.log 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41623.log 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47249.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47249.log.gz 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30354.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30354.log.gz 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64002.log 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41623.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41623.log.gz 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60777.log 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53657.log 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64002.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64002.log.gz 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60777.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60777.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39708.log 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53657.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53657.log.gz 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54671.log 2024-04-25T09:43:02.563 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58712.log 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39708.log: /var/log/ceph/ceph-client.admin.54671.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39708.log.gz 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54671.log.gz 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62901.log 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43825.log 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58712.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.58712.log.gz 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.62901.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62901.log.gz 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33809.log 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.43825.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43825.log.gz 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30396.log 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33809.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33809.log.gz 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.30396.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30396.log.gz 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47822.log 2024-04-25T09:43:02.564 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.51247.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44044.log 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.47822.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47822.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48780.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44221.log 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44044.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44044.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52840.log 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56076.log 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44221.log: /var/log/ceph/ceph-client.admin.52840.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44221.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52840.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60637.log 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46454.log 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56076.log: /var/log/ceph/ceph-client.admin.60637.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56076.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60637.log.gz 2024-04-25T09:43:02.565 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32222.log 2024-04-25T09:43:02.566 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56118.log 2024-04-25T09:43:02.566 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46454.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46454.log.gz 2024-04-25T09:43:02.566 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32222.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32222.log.gz 2024-04-25T09:43:02.566 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40862.log 2024-04-25T09:43:02.566 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.56118.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56118.log.gz 2024-04-25T09:43:02.579 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40902.log 2024-04-25T09:43:02.579 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29606.log 2024-04-25T09:43:02.579 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40862.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40862.log.gz 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40902.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40902.log.gz 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33156.log 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29606.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29606.log.gz 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31893.log 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33156.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33156.log.gz 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31893.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31893.log.gz 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32787.log 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45000.log 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32787.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32787.log.gz 2024-04-25T09:43:02.580 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49367.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49675.log 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45000.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45000.log.gz 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44312.log 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.49675.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49675.log.gz 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.46363.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58434.log 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44312.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44312.log.gz 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29648.log 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57587.log 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58434.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58434.log.gz 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29648.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29648.log.gz 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39757.log 2024-04-25T09:43:02.581 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57587.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57587.log.gz 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33970.log 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53896.log 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.39757.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39757.log.gz 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.33970.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33970.log.gz 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31139.log 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.53896.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53896.log.gz 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57629.log 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31942.log 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31139.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31139.log.gz 2024-04-25T09:43:02.582 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57629.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57629.log.gz 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31942.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31942.log.gz 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65183.log 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37125.log 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48535.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65183.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65924.log 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65183.log.gz 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.37125.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.37125.log.gz 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45587.log 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57105.log 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.65924.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.65924.log.gz 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.45587.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45587.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58265.log 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:02.583 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57105.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57105.log.gz 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29238.log 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60539.log 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.58265.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58265.log.gz 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.29238.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29238.log.gzgzip 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60539.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60539.log.gz 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60321.log 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.44720.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.60321.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60321.log.gz 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61277.log 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34573.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42315.log 2024-04-25T09:43:02.584 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41673.log 2024-04-25T09:43:02.585 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.61277.log: /var/log/ceph/ceph-client.admin.42315.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42315.log.gz 2024-04-25T09:43:02.591 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64042.log 2024-04-25T09:43:02.591 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.41673.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41673.log.gz 2024-04-25T09:43:02.597 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50046.log 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.64042.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64042.log.gz 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34493.log 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.50046.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50046.log.gz 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28665.log 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34493.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34493.log.gz 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67058.log 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28665.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28665.log.gz 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48660.log 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.67058.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67058.log.gz 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40764.log 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48660.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48660.log.gz 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59228.log 2024-04-25T09:43:02.598 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40764.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40764.log.gz 2024-04-25T09:43:02.599 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54367.log 2024-04-25T09:43:02.599 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59228.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59228.log.gz 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32529.log 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.54367.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54367.log.gz 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57538.log 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32529.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32529.log.gz 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32669.log 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.57538.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57538.log.gz 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40156.log 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.32669.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32669.log.gz 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38259.log 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.40156.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40156.log.gz 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48878.log 2024-04-25T09:43:02.603 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.38259.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38259.log.gz 2024-04-25T09:43:02.604 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59549.log 2024-04-25T09:43:02.605 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.48878.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48878.log.gz 2024-04-25T09:43:02.605 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28625.log 2024-04-25T09:43:02.605 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.59549.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59549.log.gz 2024-04-25T09:43:02.605 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.28625.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28625.log.gz 2024-04-25T09:43:02.640 INFO:teuthology.orchestra.run.smithi165.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.56635.log.gz 2024-04-25T09:43:02.657 INFO:teuthology.orchestra.run.smithi165.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T09:43:02.826 INFO:teuthology.orchestra.run.smithi165.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.29374.log.gz 2024-04-25T09:43:02.956 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.34000.log.gz 2024-04-25T09:43:02.961 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.61277.log.gz 2024-04-25T09:43:05.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-25T09:43:22.455 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T09:43:23.063 INFO:teuthology.orchestra.run.smithi172.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T09:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-25T09:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m21.218s 2024-04-25T09:43:23.065 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m40.452s 2024-04-25T09:43:23.066 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m1.407s 2024-04-25T09:43:24.143 INFO:teuthology.orchestra.run.smithi165.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T09:43:25.404 INFO:teuthology.orchestra.run.smithi165.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T09:43:25.407 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-04-25T09:43:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m23.593s 2024-04-25T09:43:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m48.952s 2024-04-25T09:43:25.407 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m2.103s 2024-04-25T09:43:25.407 INFO:tasks.ceph:Archiving logs... 2024-04-25T09:43:25.408 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/remote/smithi165/log 2024-04-25T09:43:25.409 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:43:33.898 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/remote/smithi172/log 2024-04-25T09:43:33.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:43:40.791 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T09:43:40.801 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T09:43:40.801 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:43:40.805 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:43:40.894 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T09:43:40.903 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T09:43:40.903 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:43:40.906 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:43:40.920 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:43:40.922 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-25T09:43:40.925 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:43:40.925 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-04-25T09:43:40.925 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +1032us[+1036us] +/- 45ms 2024-04-25T09:43:40.925 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -1634us[-1634us] +/- 68ms 2024-04-25T09:43:40.926 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +31us[ +31us] +/- 61ms 2024-04-25T09:43:40.926 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:43:40.927 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T09:43:40.927 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-25T09:43:40.927 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +1060us[+1060us] +/- 45ms 2024-04-25T09:43:40.927 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -1616us[-1616us] +/- 68ms 2024-04-25T09:43:40.927 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 +55us[ +55us] +/- 61ms 2024-04-25T09:43:40.927 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T09:43:40.928 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T09:43:40.938 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T09:43:40.939 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T09:43:40.948 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:43:41.048 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T09:43:41.112 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:43:41.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:43:41.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T09:43:41.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:43:41.169 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T09:43:41.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T09:43:41.190 INFO:teuthology.task.internal:Duration was 1399.453584 seconds 2024-04-25T09:43:41.190 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T09:43:41.200 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T09:43:41.201 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:43:41.203 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:43:41.238 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:43:41.247 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T09:43:41.490 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T09:43:41.490 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-04-25T09:43:41.491 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:43:41.553 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-04-25T09:43:41.553 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:43:41.577 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T09:43:41.578 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:43:41.595 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:43:41.643 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T09:43:41.643 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:43:41.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:43:41.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T09:43:41.797 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T09:43:41.797 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:43:41.821 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:43:41.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T09:43:41.854 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:43:41.863 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:43:41.883 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-04-25T09:43:41.906 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-04-25T09:43:41.926 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:43:41.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:43:41.967 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:43:41.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:43:41.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T09:43:41.992 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T09:43:41.993 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/remote/smithi165 2024-04-25T09:43:41.993 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:43:42.043 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-04-25_08:07:11-crimson-rados-wip-matanb-crimson-testing-april-22-distro-crimson-smithi/7672981/remote/smithi172 2024-04-25T09:43:42.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:43:42.076 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T09:43:42.076 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:43:42.079 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:43:42.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T09:43:42.139 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T09:43:42.139 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T09:43:42.197 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T09:43:42.197 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:43:42.200 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:43:42.211 INFO:teuthology.orchestra.run.smithi165.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:43 /home/ubuntu/cephtest 2024-04-25T09:43:42.214 INFO:teuthology.orchestra.run.smithi172.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:43 /home/ubuntu/cephtest 2024-04-25T09:43:42.215 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T09:43:42.225 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T09:43:42.292 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} duration: 1399.4535839557648 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-04-25T09:43:42.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:43:42.365 INFO:teuthology.run:pass